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(57) Abstract 

The present invention is an improvement over previous electronic programming guides "EPCi" in that it provides among other ^things: 
improved view!" interaction capabiliues with the EPG; improved viewer control of video record.ng (46) of future-scheduled P»g™muiS. 
ZnrZtl f«3 s of Ae EPG display and navigation (10); parental control of the EPG display; improved televis.on program access by 
Kewe, ?W i^^S^X^tc, the commercial advertiser to reach the viewer's profile (14. 16); improved products 
Sorption acces TZ *e viewer (12)- creation of the viewer's profile (36. 52); utilization of the viewer profile mformat.on to customize 
la5™s as^ts of the EPG (24); and utilization of viewer profile information to provide the customized presentat.on of adverting to the 
j viewer (24). 
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SYSTEMS AND METHODS FOR DISPLAYING AND RECORDING CONTROL INTERFACES 



FIELD OF THE INVENTION 

The present invention relates generally to television systems, and more particularly, 
to the display of. and recording control interface with, television programs, video, advertising 
information and program scheduling information. 



BACKGROUND OF THE INVENTION 

Television viewers have historically analyzed the information provided by television 
program schedule guides to select television programs to watch. Historically, television 
program schedule guides have listed the available television programs by day of the week, 
time of day, channel, and program title. Historically, only hardcopy television program 
schedule guides were available. More recently, as illustrated by the Levine Patent. U.S. 
Patent No. 4,908,713, television program guides have become available in electronic form. 
The earliest versions ofon-screen electronic program guidesX'EPG' 1 ) provided for the storage 
of program schedule information in an electronic memory connected to the television receiver 
and generally provided for the on-screen formatting and display of the program schedule 
information on the television screen. The early EPGs typically overlaid the television 
programming. Furthermore, viewer interaction capabilities with early EPGs was extremely 
limited. 

Later EPGs provided viewer-to-EPG interaction improvements and provided Picture- 
In-Guide ("PIG") display of the television program simultaneous with the display of the EPG. 
International Application No. PCT/US95/1 1 173 (International Publication No. WO 
96"/07270)71:Ke"lliscIpsure" of which is incorporat ed b y reference herein for all purposes, 
illustrates such an improvement. 

SUMMARY OF THE INVENTION 
35 The present invention is an improvement over previous EPGs in that it provides, 

among other things: 

A. Improved viewer interaction capabilities with the EPG; 

B. Improved viewer control of video recording of future-scheduled programming; 

C. Improved features to the EPG display and navigation; 

-1- 



3NSDOCIO <WO„. 9S04S61A1 l.> 




20 



25 



► O 99/04561 



PCT/US98/I5093 



D. Parental control of the EPG display; 

E. Improved television program information access by the viewer; 

F. Improved opportunities for the commercial advertiser to reach the viewer; 

G. Improved product information access by the viewer; 

H. Creation of a viewer's profile'; 

I. Utilization of viewer profile information to customize various aspects of the EPG: 
and J. Utilization of viewer profile information to provide customized presentation ' 
of advertising to the viewer. 

DESCRIPTION OF THE DRAWINGS 

These and other features, aspects, and advantages of the present invention will, become 
better , .understood with regard to the following description, appended claims, and 

accompanying drawings where: -— 

— — ^FIGT-is-a-graphic^^resentation of a sampie~screen display of the EPG. 

FIG. 2 is a drawing of a portion of a remote control device that shows keys for 
activating various functions of the EPG. 

FIG. 3 is a graphic representation of a sample on screen EPG display depicting the 
EPG's on-screen Grid Guide in the programming scrolling mode. 

FIGS. 4a and 4b is a graphic representation of a sam ple on screen EPG display 
depicting the EPG's on-screen Grid Guide in the channel-scrolling. 

FIG. 5 is a graphic represenTati6n~oT a sample on scfeen'EPG display depicting the 
EPG in the Watch Scheduling Function. 

FIG. 6 is a graphic representation of a sample on screen EPG display depicting the 
Watch/Record Schedule screen of the EPG. 

FIG. 7 is a graphic representation of a sample on screen EPG display depicting the top 
level theme screen display of the EPG. 

FIG. 8 is a graphic representation of a sample on screen EPG display depicting the 
second-level theme screen display of the EPG. 

FIG. 9 is a graphic representation of a sample on screen EPG display depicting the 
Channel Guide function of the EPG. 

FIGS. 10a and 10b are graphic representations of sample on screen EPG displays 
depicting one embodiment of the feature of presenting additional information concerning the 
subject matter of a highlighted Panel Ad Window. 
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DETAILED DESCRIPTION OF THE INVENTION 

The disclosure of International Application WO96/07270. published on March 7. . 
1996 is incorporated fully herein by reference. The present invention is an improvement on 
the electronic program guide- (EPG) disclosed therein. The apparatus disclosed in the 
referenced PCT application is used to generate the screen displays described below. 

In FIG. 1 of the drawing, one embodiment of the EPG with Ad Window and , 
Advertising Messages is shown. In FIG. 1. a television screen display 10 is shown. Display, 
10 could be generated by a conventional television 'receiver with interlaced scan lines, by a 
VCR, by a PC monitor with progressive scan lines, or by another other type of video display 
device. In the upper left hand corner of the screen is a PIP window 12. Below window 1 2 are 
Panel Ad Windows 14, and 16 ("Ad Windows'). Windows 12, 14. and 16 each typically 
occupy about 1/9 of the total screen area. The remainder of the screen area is typically 
occupied (moving from top to bottom of the screen) by an action key bar 1 8, a navigation bar 
20. a grid guide 22 ("Grid Guide"), and an information box 24 (the "detailed information 
area). 

In FIG. 2 of the drawing, one embodiment of a remote controller 26 for activating the 
functions of display 10 is shown. Remote controller 26 could have other keys for activating 
) the functions of a user video device, such as a television receiver, a VCR, or a cable box. 
Remote control 26 has up, down, right, and left arrows keys 28, 30, 32, and 34. respectively, 
for controlling the movement of a cursor 36 on display 10. Cursor 36 can select, i.e.. . 
highlight, any of windows 12, 14, or 16 by pressing arrow keys 28 to 34, any of the titles and 
channels in Grid Guide 22 by pressing arrow keys 32 and 34, or navigation bar 20 by pressing 
5 arrow keys 32 and 34. Windows 12, 14. and 16 are highlighted by adding a border around 
the window or changing the color of the border, if the border is permanent. The titles and 
channels in Grid Guide 22 and navigation bar 20 are highlighted by changing color. 

Highlighting of windows and/or viewer selections from the Grid Guide and/or 
navigation and EPG on screen display components may be accomplished in a number of other 
0 ways. For instance, the border of a selected window, or the selected Grid Guide or navigation 
component, can be made to appear to flash. Another way to highlight a viewer selection is 
to make the selected window or feature appear to become brighter than the rest of the on 
screen display. Yet another way to highlight a viewer selection is to blur all portions of the 
on screen display, except for the viewer selected component. Still another way to highlight 
15 a viewer selection is to make all portions of the on screen display, except for the viewer 
selected component, appear transparent. Still yet another way to highlight a viewer selection 
is to add animation to the selected component. When a portion of the EPG is selected, the 
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system issues graphic display commands to the on screen display (OSD) controller to 
implement one or more of the desired enhancement technique(s). 

The viewer enters the Guide Mode illustrated in FIG. 1 by pressing a "guide" key 35 
and returns to the full screen Television Mode by pressing key 35 again or by pressing the 
"select" key. A real time television program is' displayed in window 12. A translucent 
overlay of the PIP Window 12 can displays the title, channel (local number and/or station 
name)' and status (locked or unlocked) ofwindow_12 over the television program so the 
viewer can still see the entire image. 

The PIP Window can be locked or unlocked. The "lock/unlock" function is user 
controlled. To lock or unlock the PIP Window, the viewer can use a PIP button on the remote 
control device, or can highlight and press the Lock/Unlock EPG action button. The 
lock/unlock status is recorded and maintained until the status is reset by the viewer. That is. 
the lock/unlock status for the PIP Window in the'EPG is maintained when the viewer leaves 
the Guide and later re-entersThe Guide, including when the viewer turns off the television. 
If the viewer selects the ^ock'Vstatus^the last channel to which the tuner was set in the PIP 
Window continues to be displayed regardless of the actions exercised by the viewer. In the 
unlocked status, the channel highlighted by cursor 36 in Grid Guide 22 is displayed it the 
Grid Guide is displaying currently telecast programs and the last currently telecast channel 
that was highlighted is displayed if the Grid Guide is displaying future programs. 

There are generally three results to leaving the Guide, depending upon the way the 
viewer leaves the Guide. If the viewer; while in the EPG, wants to watch in full screen mode 
the program shown in the PIP Window, then the viewer can press the Guide button on the 
remote control device. If the viewer, while in the EPG, highlights a particular channel in the 
Grid Guide, and then presses the -select" button, the viewer will leave the Guide to view ,n 
the full screen mode the television program that the viewer highlighted in the Guide. If the 
viewer, while in the EPG, presses the "clear" or "cancel" button on the remote control device, 
then the viewer will leave the Guide and return to the television program that the viewer was 

30 watching immediately before entering the Guide, _ 

Typically an ad for a future telecast program is displayed in window 14. This ad is 
linked to 'the time and channel of the program in RAM so the viewer can watch or record the 
program automatically by pressing the blue left action button to watch the program, or the 
green right action button to record the program. 

Typically, an ad for a product or service is displayed in window 16. This ad is linked 
to more information about the product or service in RAM so the viewer can read one or more 
pages about the product or service in window 1 6 by pressing an "info" key 40 one or more 
times Alternatively, this ad is linked to the time and channel in RAM that an intomercial 
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about the product or service will be telecast so the viewer can watch or record the intbmercial 
automatically by pressing "select" key 42. 

Bar 1 8 displays a blue button 44 and/or a green button 46 with legends that depend 
upon the context of the information displayed on the screen. Remote controller 26 has 
corresponding keys 48 and 50. respectively, to activate' the functions represented by blocks 

44 and 46. ' , 

From window 12. 14. or 16 the viewer moves to grid guide 22 by pressing arrow key 
32. (From grid guide 22 the viewer moves to window 12. 14. or 16 by pressing arrow key 
34.) In grid guide 22 the viewer moves cursor 36 to highlight one of the nine tiles in which 
channel and title are displayed by pressing arrow keys 28 and 30. The viewer can view 
program listings scheduled at future times by pressingkeys 32 or 34 to move horizontally 
about, the Grid. 

j 5 From grid guide 22 the-viewer moves to.navigation bar 20 by pressing arrow key 28. 

Initially, the center button is highlighted. To highlight a different button, arrow key 32 or 34 
is pressed. To enter the screen represented by the highlighted button, "select" key 42 is 
pressed. 

In grid guide 22 details about the program represented by the highlighted tile are 
20 displayed. If more information is available this fact is indicated by an icon and such 
information is displayed in the area occupied by grid guide 22, instead of the grid guide by- 
pressing "info" key 40. To return to the grid guide, "info" key 40 is pressed again. After an 
action button has been pressed or an icon on navigation bar 20 has been activated, an 
instructional prompt may be substituted for the program information in information box 24. 

In addition to the tiles representing television programs, a virtual channel ad can be 
displayed in grid guide 22 on a tile 52. A virtual channel ad may promote, for instance, a 
current or future television program. Such a virtual channel ad for a television program is 
linked to the time and channel of the program in RAM so the viewer can watch or record the 
program automatically by pressing "select" key 42 in the manner described in the referenced 
application. More than one virtual channel ad may be stored in RAM, but preferably only one 
such ad is displayed at a time. 

Reference is made to the TV Guide Plus+ 98 User Interface Specification vl.42stv. 
which is attached hereto as Appendix A. the disclosure of which is incorporated by reference 
as if fully stated herein, for more description of the invention. 

One embodiment of the hardware for this invention includes a circuit board consisting 
of a gate array that provides all of the control functions for access by the processor (e.g.. 
Motorola 68000), control of memory (dynamic RAM and external ROM), and some 
peripheral functions such as infrared ("IR") input and output, frequency synthesizer for the 
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paging system, and data acquisition from the paging system. Inside there is a module for 
creating an on-screen display including a programmable DMA (direct memory access) 

5 controller, a color lookup table that provides for a field called a color index that can be used 
to select a more complicated color (more bits than can be expressed in the bit map), first-in- 
first-out ("FIFO") memory for ordering the pixels (which allows the system to write the 
pixels as fast as the system is capable of writing the pixels and then sending the pixels to the 
display according to a prescribed timing. Included in the chip is a timing subsystem that 

10 produces a number of different timing signals of varying frequency— from clocks td long 
millisecond time measurement, and interrupts. Synchronization signals for the television 
monitor are also generated by the internal timing subsystem. The system also typically 
includes circuits for functions including but not limited to: data receiver, memory controller, 
timing interface with the processor, data deinterleaving, error correcting, and synchronous 

1 5 timing generator with horizontal and vertical counters. 

Another feature of one embodiment of the EPG system hardware is that display list 
hardware is capable of both video input and output on the same DMA hardware. The display 
processor is comprised of a video section and a FIFO section in an ASIC. The system has 
multiple clocks. The display memory has the capability to store 8 screen tiles in a horizontal 

20 plane. 

Described below in more detail are the following improvements to an EPG: 

A. Improved viewer interaction capabilities with the EPG, including: 

1 . A Variety of Operating Modes. 

2. Joy Stick and Track Ball Viewer Remote Interface. 

25 3. Contextually Sensitive EPG On-Screen Control Mechanisms. 

4. . Watch Scheduling. 

5. "All Channel" Guide Format, Channel Guide Format and 
"Next'TTrevious" Channel Guide. 

B. Improved viewer control of video recording of future-scheduled programming. 
30 including: 

1 . Recording program displayed in PIP window. 

2. Recording "Regularly.^ 

3. Record Function rerun filter for "Regularly" recorded programs. 

4. Skip recording instruction. 

35 5. Automatic Record List Update. 

6. Recording on recordable Digital Video Discs. 

7. Speed Sensitive Tape Capacity. 

8. Record Instruction Conflict Resolution. 

-6- 
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9. Recording from Theme Guides. 

C, Improved features to the EPG display and navigation, including: 
5 1. E-mail, 

2. Multiple Viewable "Windows." 

3. Translucency onrscreen effects. 

4. On-screen notifications. 

- - 5. Theme navigation, bar. ' t 
JO 6. Improved Scrolling through the EPG and Smooth Scrolling. 

7. "Jumping" in the EPG. , 
- 8. Thematic color-coding of program schedule. 
9. Controllable number of days of programming. 

D. Parental control of the EPG display ; 

j 5 E. Improved tele vision program information access by the viewer, including; 

1. Virtual Channel Ad Slots and Ad Window program advertisements. 

2. Additional detailed information for viewer access including link to the 
— Internet.- — - — , - 

F. Improved opportunities for the commercial advertiser to reach the viewer. 



20 


including: 






1. 


Ad Window product-related video clips and infomercial recording 




2. 


Ad Window program-related recording. 




—j. 


Panel Ads, — - 




4. 


Virtual Channel Ad Slots. 


25 


5. 


Placeholder Ads- — 




6. 


Full Screen ads. 




7. 


Automatic watch channel. 




8. 


Ad Features. 




G. Improved product information access by the viewer, including: 


30 


1. 


Ad Window product detail. 




2. 


Ad Window product-related recording. 




3. 


Ad Window program-related recording. 




H. Creation of a viewer's profile, including: 




1. 


Collecting viewer profile information. 



2. Analyzing and characterizing viewer profile information. 
I. Utilization of viewer profile information to customize various aspects of the EPG: 
and J. Utilization of viewer profile information to provide customized presentation 
of advertising to the viewer. 
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A. IMPROVED V1F.WER INTERACTION CAPABILITIES W ITH THE EPG 

1. A Variety of Operating Modes. 

Under the improved EPG system, there are multiple modes in which the viewer can 

operate the television. 

a. Television Mode. r , 
In the Television Mode, the viewer watches a full screen display of the television , 
video programming. In one embodiment, in order to enter the EPG. the viewer presses the 
"Guide" key on the viewer's remote control device. In another embodiment, the EPG Grid 
Guide is the default mode. In the case where the EPG Grid Guide is the default mode, when 
the viewer turns the television on. the first thing that the viewer sees is the EPG in Grid Guide 
Mode as is described more fully below. In one embodiment, at the viewer's option, as 
identified in the EPG set up procedure, the viewer can override the EPG Grid Guide default 
mode by selecting to automatically enter the Television Mode whenever the viewer first turns 
on the television. During setup procedures, the viewer can further instruct the EPG to 
automatically tune to the last-watched channel as identified when the viewer last turned off 
the television. The viewer can further instruct the EPG to automatically tune to the viewer" s 
favorite channel, as is deduced from analyzing the viewer's profile information, described 
below. Alternatively, the viewer can instruct the EPG to automatically tune to a particular 
channel, e.g.. a news channel such as CNN. 



55 



b. EPG Grid Guide Mode. 
In the EPG Grid Guide Mode, the EPG displays the Grid Guide, or in the alternative, 
a Channel Guide. The viewer can request that the Grid Guide occupy the entire screen, be 
displaved over a portion of the screen as an overlay of the video television programming, or. 
in the preferred embodiment, occupy only a portion of the screen, typically 2/3 of the entire 
screen, while continuing to show the video television programming in the PIP Window ot the 
screen In the preferred embodiment, multiple Windows are displayed for the viewer, as are 
further described below, including at least: the EPG/Grid Guide Window, the PIP Window. 

and the Ad Window. 

Scrolling through the Guide is described below. The viewer can press the "Menu 
key on the viewer's remote control device to go to the top of the Guide. 

The viewer can return to the full screen display of the video television programming 
in a number of ways. One way is to press the "Guide" key on the viewer's remote control 
device. Another way is to press the "Select"" key on the viewer's remote control device 
when the on-screen highlighting/cursor is highlighting a particular program listing on the 
Grid Guide for a program that is available for real-time viewing. Another way is to press the 
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"last channel*' key on the viewer's remote control device to return to the program the viewer 
was watching before entering the Guide, or the last program on which the PIP window was 
5 locked (an option explained further below). 

1.) Theme Guide Function* 
The EPG provides various Theme Guides, e.g., sports, movies, news. etc. Each 
Theme Guide presents program listings associated with a particular theme, e.g.. all sports 
1 0 programs. The Theme Guide display format only displays program listings, and consequently 
channels, for certain times of the day, with content appropriate for the selected theme. For 
instance, the Sports Theme Guide will display, typically in schedule order, only listings for 
channels that carry sports programs that are scheduled during a certain period of time, e.g.. 
48 hours. 8 days, etc.. 

15 . 

. _ 2.)_ Record Selection Function. 

In the Record Selection Function, also referred to as the Recording Function, the 

- viewer instructs the EPG what programs to add to the Record List, which is the list of 

programs and related programming schedule information, for programs that the viewer want 

20 to have recorded. As- -is- further -described below, the viewer can identify the 

_Trequency/regularity_with which the viewer wants to record each program listed in the Record 

List. 

- The -viewer-can-enter the Recording Function in a number of ways. The viewer can 
press the "Record" key, if there is one, on the viewer's remote control device. Alternatively. 
25 the viewer can "press" a -Record" action button on the EPG display. 



3. ) Watch Scheduling Function. 

In the Watch Scheduling Function, also referred to as the Watch Function, the viewer 
instructs the EPG what programs to add to the Watch List, which is the list of programs and 
related programming schedule information, for programs that the viewer want to watch. As 
is further described below, the viewer can identify the frequency/regularity with which the 
viewer wants to watch each program listed in the Watch List. 

The viewer can enter the Watch Function in a number of ways. The viewer can press 
the "Watch" key, if there is one, on the viewer's remote control device. Alternatively, the 
viewer can "press" a "Watch" action button on the EPG display. 

4. ) Data Download Function. 
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In some embodiments, data for the EPG schedule, and/or supplemental information 
relevant to the program listings, and/or advertising data, can be downloaded to the memory ( 

5 resident at the viewer's television system. In the preferred embodiment of the download data 
system, the viewer will ask the EPG to make certain types of information available: the EPG 
will use an index of where to find the information and will automatically connect , to the 
appropriate data source and will download the information. Data for the EPG schedule. , 
and/or supplemental information relevant to the program listings, and/or advertising data, can 

10 be downloaded from various sources. In one embodiment, data is downloaded from the 
Internet. In other embodiments of the download data system, the viewer is asked to tune to 
a particular channel at a particular time if the viewer is interested in accessing and 
downloading particular types of information. 

j 5 c. • Internet Mode. 

Mot all embodiments require that data be downloaded to the EPG memory. In one 
embodiment, the EPG scheduling data, supplemental data and/or advertising data and the 
software to format, display, and navigate the EPG scheduling data, supplemental data and/or 
advertising data is accessed by the viewer's television system through a direct link between 
20 the viewer's television system and the Internet. 

In one embodiment of the above-described direct-link to the Internet, the viewer" s 
television is^connectedlolhe Internet by telephone" line" via modem, by cable modem, by- 
other two-way communication device, including wireless modem communication devices and 
by other conventional methods of communicating with the Internet. The initial connect web 
site address may be supplied, for instance, through information transmitted to the viewer" s 
television over the vertical blanking interval (the "VBI"). The viewer may also be provided 
with a selection of multiple EPG Internet web sites. The viewer uses the remote control 
device to select one of the EPG Internet web sites 

The viewer's television system is programmed to emulate computer on-line access 
to the Internet. Once the connection between the viewer's television system and the Internet 
is made, the user has two-way communication with the on-line Internet service provider of 
the EPG related information. The user can then navigate through the EPG. Furthermore, in 
one embodiment, in which keyboard user interface is available, the user can enter chat rooms 
or other interactive services. 



25 



30 
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2. 1n Y Stick anri Track Ball Viewer Remote Interface. 

The viewing user's video interface (Ul) comprises the viewer's remote control device 
and the television monitor screen display. In one embodiment of the present invention, one 
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improvement in the UI offered by the present invention is the use of a.joy stick as a substitute 
for the traditional remote control device configuration of a circle of four (.4) arrow keys t up. 
5 down, left and right) with a select key in the center. The joy stick UI provides a user-friendly 
interface with the EPG. Use of the joy stick is intuitive. The viewer/ user does not have to 

look at the remote once the viewer's firmer contacts the remote control iov stick. 

- r i j - 

Accordingly, the viewer can control the UI while , simultaneously watching, without 

interruption, the on-screen display. 
10 In another embodiment of the present invention, one improvement in the UI offered 

by the present invention is the use of a track ball as a substitute for the traditional remote 

control device configuration of a circle of four (4) arrow keys (up, down, left and right) with 

a select key in the center. 

In both the track ball and the joy stick embodiments, there is an on-screen "cursor." 
1 5 The viewer uses the track ball or joy stick remote control 'device to navigate the cursor to any 

Jocation on the screen, much as a PC user navigates a cursor on a PC terminal window-. 

3. Contextuallv Sensitive EPG On-Screen Control Mechanisms. 

"Keys." "buttons," menu "bars," and other such visual control mechanism devices are 
20 displayed on-screen for the control of the EPG. Typically.,, the. visual control mechanism 
devices are sensitive to user-interaction. Typically, the viewer uses the UI remote control 
device to highlight a particular on-screen control device. Typically, the viewer then uses the 
UI remote control dev_i_cje_to_s.elect the highlighted on screen control device. 

In one embodiment of the present invention, positionally constant on-screen control 
25 devices are contextually sensitive. That is. a particular button can be consistently displayed 
on every screen of the EPG in the same position and with the same color, from one screen to 
the next, from one mode to the next. With contextually sensitive control devices, even 
though the on screen control device has the same appearance and placement from one screen 
to the next and from one mode to the next, the button has a different function, and if selected. 
30 will provide a different result, depending upon the screen on which the button appears. In 
one embodiment, the function of the on-screen control device is textually described next to 
the control device, or, if the control device is sufficiently large, on the face of the control 
device. 

For instance, in one embodiment, as illustrated in FIGS. 3. 4a and b. 5. and 6. the EPG 
35 displays two buttons at the top of each of the four screens pictured. In each of the four 
different screens, the top left button has a different function. (As referred to in this 
application, the directions "left" and "right" refer to the viewer's left and the viewer's right, 
respectively.) FIG. 3 depicts the EPG's on-screen Grid Guide in the programming scrolling 
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mode. In FIG.3. the viewers-left button is described as - Watch." FIGS. 4a and 4b depict 
the EPG s on-screen Grid Guide in the channel-scrolling. In FIG. 4a and b. the viewer s-left 
5 burton >s a toggle button, alternately described as "Lock" and "Unlock." FIG 5 depicts the ' 
EPG ,n the Watch Scheduling Function. In FIG. 5. the viewer's-left button is described as 
Cancel. FIG. 6 depicts the Watch/Record Schedule screen of the EPG. In FIG. 6 the 
viewer*s-left button is described as -'Remove." 

10 4: Watch Scheduling ", ! ~ 

The EPG provides the viewer with the opportunity to select program titles, scheduled 
for delivery at future times, to watch. By selecting program titles, the viewer builds a "watch 
list." Watch list options and instructions provide functionality parallel to the EPG's Record 
Function. Instead of automatically recording the programs selected, the Watch Function 
1 5 automatically turns the television on. if it is not already on, and automatically tunes the 
televisi on to the c hannel schedul ed todeliver the designated program, if the television is not 
already tuned to that channel. This feature provides the viewer with the opportunity to watch 
a program of special interest at the scheduled time even if the viewer has forgotten about the 
scheduled delivery. This feature will also provide for parental selection of program viewing 
20 for children. 

The viewer can enter the Watch Scheduling Function in a number of ways. The 
viewer can enter the Watch Scheduling Function by selecting that Function from the EPG 
menu. The vie wer can also enter the_Watch Scheduling Function by highlighting an Ad 
Window displaying an advertisement for a future-scheduled program or a Virtual Channel 

25 Ad Slot displaying an advertisement for a future-scheduled program (both of which are 
described elsewhere in this application). 

The viewer can designate any program on the Watch List as a program that the viewer 
wants to watch regularly. In one embodiment, if the viewer enters the Watch Scheduling 
Function by highlighting an Ad Window or Virtual Channel Ad Slot, then if the viewer 

30 chooses to designate the program as a "regular" watch, the designation expires after a certain 
amount of time if the advertiser stops running the advertisement. The planned expiration is 
an incentive to the advertisers to renew their advertisements. 

5 ^AU — Channel" Guide Fo rmat. Channel Guide Format an H 

35 "Next'T'Previous" Channel Guide. 

The viewer can choose to view the Grid Guide in an "all channel" format which 
displays in some order every channel and the listings of programs already in progress or 
scheduled to begin at some time in the future. In the "all channel" format, the viewer scrolls 
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up and down the listings for each channel and from left to right and right to left to view the 
listings for a channel scheduled for different times during the day. Typically, the left-most, 
5 portion of the guide begins with the earliest scheduled programs and continues to the right 
serially through the listings scheduled at later times during the day. 

As an alternative, the viewer can choose to view the programs scheduled for one 
channel at a time (a "Channel Guide"). In this format, the viewer scrolls up and down the ( 
listings for a single channel as scheduled for different times of the day. Typically, the "top'* 
10 of the Channel Guide begins with the earliest' scheduled program and continues serially 
through the listings scheduled at later times during the day. FIG. 9 is a graphic representation 
__of a sample on screen EPG display depicting the Channel Guide function of the EPG. 

In the ''Channel Guide" format, the viewer can select to view the Channel Guide for 
the "next" channel or for the "previous" channel. In one embodiment, the "Next" and 
1 5 '"Previous" Channel Guide is an option on one of the EPG menus, action buttons or task bars. 
In pother-embodiment, the -viewer -'s-remote control-device provides "Next" and "Previous" 
Channel Guide keys. In another embodiment, the viewer uses the up and down arrow keys 
~to navigate-to the next or previous Channel Guides. - - 

20 B. IMPROVED VIEWER CONTROL OF VIDEO RECORDING OF FUTURE-SCHEDULED 
PROGRAMMING 

1. Recording program displaye d in PIP window. 

As explained in more detail below, the EPG provides for multiple "windows." One 
25 window displays the currently tuned program. When the viewer enters the EPG from the 
television mode, the PIP window is "highlighted." In one embodiment, highlighting of the 
PIP window is accomplished by a color change of the border around the PIP window. While 
the PIP window is highlighted, the viewer can instruct the EPG to record the displayed 
program. In one embodiment the viewer records the displayed program in the highlighted 
30 PIP window by pressing the record button on the viewer's remote control device. 

2. pecordinff "Regularly." 

One embodiment of the present invention provides the viewer with the option of 
recording a particular program -regularly;' The "regularly" option can be selected when the 
35 viewer highlights a particular program title on the EPG Grid Guide. Viewer selection of the 
"regularly" option instructs the VCR control system to record the particular title on the 
selected channel at the selected time slot any day of the week that the program is telecast. If 
- a telecast of the selected title is preempted by another program, the new program is not 
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recorded. The change in the telecast schedule is determined by comparing the title of the 
selected program to the title of the program actually telecast. In one embodiment of the 
invention, it is assumed that the title of the program actually telecast is carried in the vertical 
blanking interval of the television signal. When the viewer has instructed the EPG to 
-regularly" record a particular program, if the selected program is preempted by another 
program, the preempting program is not recorded and the EPG displays a message notifying 
the viewer that the selected prpgram was preempted and was not recorded. 



3 Record Function rerun filter for "Regularly" recorded prna ramc 

The EPG is capable of detecting reruns. The identification of the program as a rerun 
may be carried in the VBI of the program broadcast. In another embodiment, the rerun 
identification information is available in the program detail. In one embodiment of the 
15 Record Function, when the viewer selects the "Regularly" record option, the viewer is also 
given the option of filtering reruns. If the viewer selects the rerun filter option, then every 
time the program is regularly scheduled, the EPG determines whether or not the program 
episode to be delivered is identified as a rerun. If the episode is a rerun, and if the viewer has 
selected the rerun filter option for that program title, then the EPG will not record the episode. 

20 

4. Skip recording instruction. 

In the EPG's Record Function, the viewer selects a program title for recording. Once 
a program title has been selected, the viewer is asked to select a record-scheduling option. 

25 The viewer can select Once. Daily. Weekly, or Regularly as a record-scheduling option. If 
the viewer has selected a record-scheduling option of Daily, Weekly, or Regularly, one 
embodiment allows the viewer to skip recording of the program one time. The One-time skip 
instruction would result in the EPG not recording the program title, even though the record 
instruction for that program title remained in the record list. 

30 In the EPG's Record Function, the viewer can turn select the skip instruction for all 

programs on the Record List, or for selected programs on the Record List. This feature might 
be used when the viewer goes on vacation. The programs remain on the Record List. At the 
viewer's option, the viewer can turn off the skip instruction for all programs on the Record 
List, or for selected programs on the Record List. 



5. Automatic Record List Update. 

In the EPG's Record Function, the EPG will detect changes in program scheduling 
as compared to record instructions for particular program titles designated for recording. In 
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one embodiment, when the EPG detects program scheduling changes, the Record List is 
automatically updated with the schedule change information. For instance, if a sports event 
runs longer than the originally scheduled time., a packet of scheduling update information cain 
be transmitted over the VBI that updates the time of the programs scheduled to be telecast 
after the sports event. The EPG detects the- 'VBI scheduling updates and updates the 
recording list to permit the recording of any programs following the sports program to be ' 
recorded as appropriate. 

6. Recording on recordable Digital Video Discs. 

The viewer can instruct the EPG to record programs on recordable Digital Video 
Discs (DVD's). Because of the extended storage capacity of DVD's, the viewer can instruct 
the EPG to record and index ah extended period of programming. For instance, the viewer 
can instruct the EPG to record and index, e.gi m 4 hours of CNN news broadcasts certain 
"number. When the viewer is ready to view the DVD recording, the EPG displays the DVD 
index on screen. The viewer can then select to view either the entire DVD, or only those 
portions of the recordi^i^wKicH^R^iewer is interested. 

In one embodiment, program-level indexing of recorded programs is created. In 
another embodimentTntra-program indexing is created by using information transmitted in 
the V BI of the video transmitted. In th is embodiment, a recording of CNN would likely show 
indexing breakdowns that include themes, such as ^International News," "National News. " 
"S^rts7"^Ente^ & Finance." and wt Weather." 

In yet another embodiment, intra-program indexing is created using some constant 
time interval. The index shows a start and end time interv al, and audio content excerpts. 

In still another embodiment, indexing software analyzes the audio content of the 
program recorded ("Content Analysis Program"). This is typically in addition to using all 
indexing breakdown information transmitted in the VBI of the program. The Content 
Analysis Program uses speech and voice recognition technology to analyze, among other 
things, such variables as: changes in announcers, changes in tone, changes in speed, topical 
words, geographic locations, substantive words. The Content Analysis Program then creates 
a topical index in addition to the theme index described above. 

7. Speed Sensitive Tape Capacity. 

The EPG's Record Function provides a Record List that identifies the titles of 
programs that the viewer has selected to be recorded. The speed sensitive tape capacity 
feature uses color coding to identify in one color the titles that would fit on one tape at a fast 
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tape speed and to separately identify, with another color, the titles that would fit on one tape 
at slow tape speed. 

5 

8. Record Instruction Conflict Resolution. 

The EPG's Record Function recognizes conflicts in viewer record instructions, in one 
embodiment, the EPG's Record Function prompts the viewer to resolve the conflict. For . 
instance, in the Record Function, the EPG would accept viewer instructions to record a ■ 

10 particular program. The EPG compares the newly received record instruction to as-yet 
incompletely executed, or as yet unexecuted, record instructions in the Record List. If the 
EPG detects an overlap in date, time and duration between the newly received instruction on 
the one hand and one or more of the remaining record instructions in the Record List, the 
EPG formats a message to the viewer describing the conflict. The message describes to the 

1 5 „„user-the_newly_receiy-edJnstruQtion.to„record a particular program and the conflicting record 
instructions in the Record List. In Record Function, the EPG will prevent entry of conflicting 
instructions into the Record List. The EPG will require that the viewer revise the record 
instructions to eliminate the conflict. In one embodiment, if the EPG detects that one 
recording instruction pertains to a "one occurrence" program that conflicts in date, time and 

20 duration with a recording instruction to record a "regularly recorded" program, the EPG 
would format an on screen message that would suggest to the viewer that the viewer select 
the "one occurrence" program to be recorded. In another embodiment, the EPG automatically 
"decides*' to override the "regularly record" instruction and will record the "one occurrence" 
program with no further intervention by the viewer. 

o 5 One way to resolve a recording instruction conflict is to chose an alternative 

occurrence of the conflicting program for recording. In one embodiment of the EPG. the 
viewer can highlight a particular program in the EPG and request a list of all occurrences of 
that program for the week. The viewer can then instruct the EPG to record an alternative 
occurrence of the program. In an alternative embodiment, the viewer can view an 

30 _ alphabetical list of all programs for the week. The viewer can mark a program for viewing 
or recording from the alphabetical list. 

9. Recording From The me Guides. 

The EPG provides various Theme Guides, e.g., sports, movies, news. etc. When the 
35 viewer selects a particular Theme Guide, e.g.. the Sports Theme Guide, the viewer can 
instruct the EPG to record an event while in the Theme Guide without having to exit the 
Theme Guide and go to the program Grid Guide. For instance, in the Sports Theme Guide, 
the viewer instructs the EPG to add a sports event to the Record List by clicking on the box 
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score for a particular sports event and/or on the spons program listing in the Sports Theme 
Guide. 

5 . 

C. IMPROVED FEATURES TO THE EPG DISPLAY AND NAVIGATION 

1. E-mail . 

.In the .preferred_embodiment, the EPG interfaces with the Internet/World Wide Web., 
10 In the preferred embodiments the -viewer can-accessHhe-lnternet to send and receive e-mail. 

In another embodiment, the television terminal is separately addressable, and the head 
end controls e-mail traffic betwjeen viewers on its network. To facilitate, two-way 
transmission a 900 or toll free number is used as a back link. E-mail can then be sent to the 
appropriate viewer through the VB1 to the viewer's separately addressable television. 

15 ' . , 

2 Multiple Viewable "Windows." _ 

The EPG UI screen provides for multiple viewable ^windows." One window presents 
- -the EPG Grid Guide.-Another window-presents-the picture-in-picture (PIP) window on which 
the currently tuned program is displayed. Another window displays advertising information 
20 -(the™ A-d-W-indow-).— Advertising-may-be-in-the-form-of-graphics and-textual information. 
_Alternatively,_advertising may be in the form of video display. In one embodiment, the Ad 
Windows are interactive. 

As the- viewer-enters the-EPG-from-the^tele-vision mode, the PIP window is 
highlighted. The viewer can lock the PIP window. Locking the PIP window allows the 
viewer tocontinue to -watch-the television program-being displayed in the PIP window while 
the viewer scrolls through the EPG program Grid Guide. Unlocking the PIP window causes 
the video for the program title highlighted in the Grid Guide to be displayed in the PIP 
window. 

As described further below, the viewer can also highlight the Ad Window. Doing so 
30 will cause additional text describing the product to be displayed in the detail box are of the 
EPG Grid Guide. 

If the Ad Window displays information about a particular product, pressing a record 
button will instruct the EPG to record an infomercial, to the extent that one is scheduled for 
a future time. Alternatively, the Ad Window can display information about a future- 
35 scheduled television program or about a series of programs to be telecast over a period of 
time. In that case, pressing a record button will instruct the EPG to record the future- 
scheduled program. Alternatively, the viewer can designate the program for the Watch List. 
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In one embodiment, the viewer navigates from the Grid Guide to the PIP Window by 
pressing the left arrow key until the cursor/highlighting reaches the PIP Window. From the 

5 PIP Window, the viewer uses the right arrow key to move back to the Grid Guide. In one 
embodiment, moving from the PIP Window to the Grid Guide causes th£ cursor to scroll to 
the very top of the Grid Guide lineup. From the top of the Grid Guide lineup, pressing the 
up arrow key moves the cursor to the navigation bar. The EPG provides several possible . 
destinations on the navigation bar, e.g.. info center, sports, news, set up. help. etc. 

10 From the PIP Window, pressing the down arrow key moves the cursor to the Ad 

Window. 

The viewer can set a default, or allow, the system default, to highlight a particular 
navigation bar destination when the viewer initially enters the Grid Guide. 

15 3. Translucency on-screen effects. ^ 

In-one embodiment, the EPG creates special translucency visual effects. To create 

the translucency effect, the system alternates the display format pixel by pixel-one pixel is 
the color of the overlay and the next pixel is transparent. 

20 4. On-screen notifications. 

The EPG formats on-screen notifications to the viewer and displays the notification 
to the viewer. On-screen notifications can be used to alert the viewer to any number of 
possible items of information. For instance, the EPG can notify the viewer that the EPG will 
begin recording a particular program within a certain amount of time, e.g., 2 minutes. The 
record notification could further ask the viewer whether to switch the cable box to record the 
prosram. If the viewer indicated that the viewer did not want the EPG to switch to the cable 
box to record the program, then the EPG would delete the program from the record list. 
Another example would be to notify the viewer that a program that may be of interest (e.g., 
as determined from analyzing the Viewer's Profile) will be broadcast on another channel 
30 -within a certain amount of time, e.g., 2 minutes. The EPG could then ask if the viewer wants 
. _._ t0 , v iew the program-on the otherchannel. If the viewer indicates that the viewer wants to 
watch the program on the other channel, then the EPG will automatically tune to the other 
channel at the appropriate time. Alternatively, the EPG could ask the viewer is the viewer 
wants to record the program on the other channel and could then record that program at the 
3 5 appropriate time if the viewer answers affirmatively. 

If the television is in television mode, the notification will be displayed on-screen. 
The notification can be displayed in a number of ways, including: 1.) a complete screen 
overlay; 2.) a partial screen overlay; 3.) The real time program video is automatically changed 
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to a PIP format, and the notification is displayed outside of the PIP window: 4.) The real time 

program video, is automatically changed to a PIP format, and the notification is displayed « 
5 inside of the PIP window; 5.)as a "watermark" some where' on-screen; 6.) an on-screen icon 

is displayed which can be "pressed" by the viewer using the navigation keys on the viewer's 

remote control device, and which, if pressed, displays the notification in one of the above 

formats; 7.) the program video is compressed slightly to fit in some percentage, e.g.. 90%. 

of the top of the "screen, and the notification is displayed as a horizontally-rolling message at * 
10 the bottom of the screen; 8,) the program video is compressed slightly to fit in some 

percentage, e.g.. 90%. of the bottom of the screen, and the notification is displayed as a 

^horizontally-rolling message at the top of the screen. 

If the television is in some mode other than the television mode, the EPG can notify 

the viewer through some modification of one of the above-described formats. For instance. 
15 _ i-f-the-television-is inJhe Grid Guide mode in a PIP format.jhen the EPG could use any of 
" —format numbers h)* 2;), 5.), 6.) ; 7:), 8.)~or, the EPG could-notify -the- viewer by displaying the 

notification in the Ad Window, a virtual ad channel slot, in the detail information window. 

of ina horizomMly-rolling-message at the top or bottom of the screen.— 



20 5. Theme navigation bar. 

The theme display is above the top of the Grid Guide. In one embodiment, the Grid 
Guide display provides for a "page up" on-screen button. In one embodiment, the Grid Guide 
' display also provides for a "memTbutton. The viewer can scroll to the top of the Grid Guide 
by successively "pressing" the page up on-screen button, or by "pressing" the menu button. 
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6. Improved Scrolling through the EPG an d Smooth Scrolling. 

In the top level screen of the EPG in Grid Guide mode, the viewer user can jump 
directly to a future day of programming schedule information. 

In one embodiment, the Grid Guide display provides for a "page up" on-screen button. 

30 Program schedule information for a plurality of channels is displayed on a screen of 

—the-EPG-in Grid-Guide mode. Titles are shortened for display in the Grid Guide to conserve 
space. The entire title is available to the system and is displayed in the detailed description 
area of the Grid Guide when the viewer highlights a tile in the Grid Guide for the 
corresponding program listing. But the EPG shortens the titles, according to a set of rules for 
35 shortening the titles, so that the titles fit in the scheduling tiles of the Grid Guide. 

The viewer can scroll up or down through the program listings. While scrolling, the 
titles are not drawn until the scrolling stops. Such a delay in drawing titles speeds up the 
processing and makes the screen appearance less confusing. While scrolling, the cursor will 
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not highlight the top or the bottom tile on the screen unless the channel is the top or bottom 
of the lineup. The absence of highlighting signals to the viewer that more channels remain 
5 in the scrolled direction. 

A further improvement to the EPG User Interface ("Wl is the development of 
"'Smooth Scrolling.' 7 When the cursor reaches the 1 second tile from the bottom, and a new tile 
appears on the bottom, the entire tile and its contents, e.g.. a program title, grow gradually in 
height until the newly appearing tile reaches full tile height. At the same time, the tile that 
1 o is disappearing from the top^f the screen7andlhe contents of that top tile, shrink in height 
until the tile is gone. This provides a smooth transition in the overall screen display but is 
not actually perceptible because it is changing' at 1/60 of a sec. 

Smooth Scrolling is less disorienting to the viewer than a page by page screen change, 
which is the scrolling technique used in existing on screen guides. The entire bit map does 
15 not need to be redrawn as you scroll up one tile-only the top tile is shrunk or compressed in 

the vertica'ndimension. 7 

In one embodiment, while slowly scrolling, the new title appearing on the screen is 
" run redrawn until the scrolling stops. While rapidly scrolling multiple tiles, the processor 
stops redrawing the title on any of the tiles during the scroll; the processor waits until the 

?0 scroll stop's or slows down to' redraw the titleiTThis permits faster scrolling because the titles 
do not have to be retrieved untU the screen reaches the desired point. Redrawing the data is 
very processor intensive. A special interaction between the firmware and the hardware is 
required to minimize redrawing the bit map and" retrieving data from memory. This applies 
to both vertical and horizontaUcroUing. The user can remain oriented because the channel 

~>5 identifiers and schedule times remain displayed. 

7. "Jumping" in the EPG. 

The viewer can "jump" to the desired action or location in the EPG in a number of 
ways. In the Grid Guide, the viewer can jump to the channel slot for a particular channel by 
entering the digits of the channel identification number on the keypad of the viewer's remote 
control device. The EPG interprets the number and calculates the proper position for the EPG 
cursor. The EPG then displays the cursor at the appropriate channel slot on-screen. 

In one embodiment, the viewer's favorite and/or most watched channels are displayed 
as buttons on a favorite channel selection bar somewhere on the EPG display of the Grid 
Guide. The viewer can jump to one of the viewer's favorite channels by '-pressing the 

appropriate channel button. 

In another embodiment, the viewer's remote control device displays letters associated 
with the numbers on the key pad. The viewer can use a special "Alt" key to allow the viewer 
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to press the keys as if alphabetic and/or alphanumeric. In this way. the viewer can enter a 
channel identifier, such as "CNN". 

In yet another embodiment, the viewer can request a pull down menu of favorite 
channel identifiers and can select a channel from the pull down menu. • 

In yet another embodiment, the viewer can set^bookmarks" in the EPG by using a 
''bookmark" kev on the viewer's remote control device, or alternatively, a ''bookmark" button 
on the EPG display. The viewer can press the ''bookmark" key when the user wants to mark 
a current location for later return. The viewer can then scroll, jump, or otherwise navigate 
away to some other location in the EPG. When the viewer wants to return to the book 
marked location, the viewer can press the "lastmark" key (on either the viewer's remote 
control device, or alternatively on the EPG display). The EPG can record a plurality of book 
marked locations. In one embodiment, the EPG can remember book marked locations after 
the viewer turns off the television and then turnson the television multiple times. 



8. Thematic color-coding of program schedule. 

■ ~- - The EPG categorizes programs according to a plurality of themes. In one 
embodiment, the EPG color codes the presentation of the program in the Grid Guide 
according to the theme categorization assigned to the program. 

9. Controllable number of davs of programming. 

Typically, the ERG. will carry only 2 days of program listings. At the viewer's 

selection, the EPG can carry only a single day of program listings. The single day option 
provides a smaller range-of-program listings but increases response time. Alternatively, the 
viewer can select to carry any number of days of program listings, up to the number of days 
that is provided for by the particular installation, which is set by the corresponding amount 
of memory storage available. 

D. PARFNTAL CONTROL OF THE EPG DISPLAY 

The Parent viewer initially enters the Parental Control Function during initial EPG 
setup procedures. In the EPG setup procedure, the Parent identifies all viewers of the 
television, and assigns individual viewer Identifiers. The Parent viewer also establishes a 
password for said Parent viewer. U.S. Provisional Patent Application Serial No. 60/085.401 
("V-CHIP Plus+: In-Guide User Interface Apparatus and Method for Programmable Blocking 
of Television and other viewable programming such as for Parental Control of a Television 
Receiver") describes Parental Control setup procedures for the identification of individual 
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viewers and initialization of password protection, the disclosure of which is incorporated by 
reference here as if fully stated herein. 

■ In the Parental Control Function, the Parent selects the channels and programs that 
can be visible in the Grid Guide for a particular viewer and selects channels and/or programs 
that are to be blocked from viewing. Child viewers, as identified during setup procedure, will 
view a simplified Grid Guide and will be blocked from viewing the programs so marked by 
the Parent. In one embodiment, individual viewers are identified by viewer ID and password. 
In another embodiment, individual viewers have different remote control devices, the use of 
which is also password protected. 

IMPROVED TELEVISION PROGRAM INFORMATION ACCE SS BY THE VIEWER 
. i. Virtual Channel Ad Slots and Ad Windo w program advertisements. 

As described below, the EPG provides the viewer with multiple opportunities to 
obtain detailed information about television programs. As is further described below, the 
EPG provides the viewer the opportunity to select Virtual Channel Ad Slots or Ad Window 
displays that advertise future-scheduled television programs and get additional information 
in the way of text or video clips. 

2. Additional detailed information f or viewer access including link to the 
Internet. 

The EPG displays detailed information relevant to program listings in the detailed 
information area of the Grid Guide. The detailed information can include, among other 
things, a detailed textual description of the program, information about the actors and 
actresses, information about the production of the program, product related information, 
identification of relevant Internet web sites and online Internet chat rooms. The EPG 
provides the viewer with the ability to request detailed information from such guides/data 
services in a number of ways, including when the viewer highlights: a particular program in 
the Grid Guide, the Ad Window, or a Virtual Channel Ad Slot. In one embodiment, the 
viewer's remote control device has a power "Information" key. When the viewer has 
navigated the on screen highlighting/cursor to a particular tile or window on the EPG on 
screen display, the viewer can press the remote control device "Information' key to request 

the additional information 

In one embodiment, when the viewer highlights a particular program in the Grid 
Guide, the Ad Window, or a Virtual Channel Ad Slot, or other requests access to detailed 
program-related information, the EPG connects the viewer with an external database of 
information, such as with a particular web site on the Internet. The viewer can instruct the 
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EPG to connect the user with detailed specialized information guides/data services, such as 
sports, news, or other guides/data services. In one embodiment, the linking to the external . 
data source is accomplished by storing a web site address with the Ad Window or Virtual 
Channel Ad Slot advertisement inthe RAM of the user terminal. 

A sports program listed in the Grid Guide provides an illuminating example of how • 
the viewer interacts with such a detailed specialized information guide/data service. When . 
the viewer highlights a football game-listed in the Grid Guide, the normal detail concerning . 
the program is displayed in the detailed information are of the Grid Guide. Furthermore, 
multiple icons related to the highlighted program can 1 be displayed in the Grid Guide. One 
icon alerts the user that the game is already underway. Another icon indicates the availability 
of specialized guide information. The viewer can select the program from the Grid Guide for 
viewing and/or recording. In addition, the viewer can select the specialized guide icon. In 
15 the cnse of a sports program, sel ect ing the s pecialized guide icon would display, for instance, 
—aTSCoreboard-for the game if-the game-were-al ready in progress-in the detailed- information 
area of the Grid Guide. If the game were scheduled for a future time, then selecting the 
" specialized guide icon would displayrfor instancerinformation about the players, the teams, 
and perhaps, the odds about the game. 

Another icon, displayed for instance in the display of the sports guide scoreboard, 
provides the-viewer with the option of connecting to the Internet, e.g.. to a particular web site 
that provides additional information about the game, possibly, including online chat about 
the game. In one embodiment, the EPG switches-to full screen to display of the Internet web 
site. In another embodiment, the EPG displays the Internet web site in the area of the screen 
previously occupied by the Grid Guide and/or the Grid Guide and the Ad Window, while 
continuing to display the real time video display of the currently tuned television program in 
the PIP window. Alternatively, the EPG can display the Internet web site in the PIP window 
and display the currently tuned television program in the area of the screen previously 
occupied by the Grid Guide and/or the Grid Guide and the Ad Window. The Internet web 
site to which- the EPG initially connects (the "contact web site") may be a specialized 
^irectoiy-using-pre-determined-hyperlinks to the viewer to other cites of interest. The 
contact web site may additionally, or in the alternative, offer search capabilities to the viewer 
to locate information of interest. 

Once the viewer is connected with a specialized information guide/data service, the 
viewer can use the guide/data service to direct the viewer to particular information contained 
in the EPG Grid Guide. For instance, a viewer selects a news program to watch. While 
watching the news program, the news broadcaster describes an event involving astronauts. 
The viewer selects the news guide/data service icon and connects to a web site on the Internet 
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describing, among other things, additional information about the particular event involving 
the astronauts. The viewer uses the search engine offered by the contact web site to locate 
additional information about the same astronauts. At the subsequent web sites, a Discovery 
Channel program is mentioned concerning some of the same astronauts. The viewer instructs 
the EPG to locate any occurrence of the referenced program and to schedule that program to 
be recorded. In one embodiment, a PLUS CODE-like address is used to link to. or record, 
the scheduled program. 

The viewer can search an index, available on the Internet and created by a news data 
service, of recorded television news programs and reports. The viewer can search the index. 
If the viewer selects one of the indexed reports, a video clip of the indexed report will be 
shown in the area on the screen occupied by the Internet web site display, or any alternate 
area or portion of the on-screen display. The viewer can instruct the EPG to record the video 

clip. ' , 

The EPGTis"capable of integrating additional information provided by the special data 
services into the EPG display. For instance, in the case of a sports data service, the EPG can 
format the program listing display and/or the sports scores for a game with special color 
coding depending upon the stage of the game. For instance, if the game is in progress, the 
EPG will format the program listing and/or the sports scores for that game with one color. 
e g i g r een; if the game is completed, the program listing and/or the final scores can be in a 
"different color, e.g., blue. If the game is in progress, the viewer can highlight and select the 
box score to move from the box score to the game shown on the television. In one 
embodiment, the selected television sports program appears in the PIP Window or the Ad 
Window, allowing the viewer to read the sports program-related story in the sports guide 
while watching the corresponding television sports program. 

The EPG is further capable of linking between news items in a special news guide and 
related television programs. The viewer can link to a news program to watch or record that 
program by highlighting and selecting a news item in a news guide. In one embodiment, the 
selected television news program appears in the PIP Window or the Ad Window, allowing 
the viewer to read the story in the news guide while watching a tv news program that reports 
on the event. 

In one embodiment, the VBI for selected channels are dedicated to the delivery of a 
special data service. For instance, the ESPN VBI would carry the sports data service only. 
In one embodiment, as an incentive to carry this data, the data service would display the 
ESPN TV program in the PIP window. Since the tuner must be set to ESPN to capture the 
data, the television signal is available for display in the PIP. 
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F. IMPROVED OPPORTUNITIES FOR THE COMMERCIAL ADVERTISER TO REACH THE 

VIEWER 

1. Ad Window product-related video clips and infomercial recording 

The EPG provides producers of infomercials with extended capabilities to reach the 
viewers through the Ad Window. Because of the cost of buying advertising lime, a growing 
number of product manufacturers and marketers produce infomercials about their products . 
and-then buy relatively inexpensive air time for their infomercials according to off-prime- 
time~~schedules. * often- on -non-prime channels. The EPG provides the producers of 
infomercials with the opportunity to provide the viewer with the opportunity to record an 
infomercial that is broadcast at a time, or on a channel, that would be inconvenient for the 
viewer to watch real-time. 

. If the Ad Window displays information about a particular product, pressing a record 
1 5 button will instruct the EPG to record an infomercial or advertisement, to the extent that one 
is scheduled for a future time. Alternatively, the viewer can designate the infomercial or 
advertisement for the Watch List. Alternatively, the EPG provides the producers of 
infomercials with-the=opportunityao provide.the viewer with the opportunity to view a video 
clip about the product being advertised. 
o 0 - In one embodiment, -the -video clip associated with the product and/or program 

displayed in the Ad Window is shown when .the viewer highlights the Ad Window. 
Depending upon theembodiment and7oTvie^^ptidn selections, the video clip is shown in 
the PIP window, in the-Ad Window, or full screen. At the.conclusion of the video clip, the 
EPG typically returns to the mode in which the viewer was operating immediately before 
-selecting the option that triggered the-display of the video clip. 



25 



30 



35 



2. Ad Window nrogram-related recording 

The EPG provides distributers of television programming with additional 
opportunities to reach the viewer. The Ad Window can display information about a future- 
scheduled television-program. Jf thejviewer is interested in recording the program, the viewer 
can take a number of alternative actions. For instance, in one- embodiment, the viewer can 
instruct the EPG to record the future-scheduled program. In one embodiment, the viewer 
presses record button on the remote control device to instruct the EPG to record the future- 
scheduled program. Alternatively, the viewer can instruct the EPG to add program to the 
Watch List. Alternatively, the viewer can instruct the EPG to display a video clip about the 
program. Yet further, the viewer can instruct the EPG to connect the user with detailed 
specialized information guides/data services, such as sports, news, or other guides/data 
services. The EPG provides the viewer with the ability to request detailed information from 
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such euides/data services in a number of ways, including when the viewer highlights: a 
particular program in the Grid Guide, the Ad Window, or a Virtual Channel Ad Slot. In one ■ 
5 embodiment, the EPG displays relevant detailed information in the detailed information area 
of the Grid Guide. In another embodiment, the EPG connects the viewer with an external 
database of information, such as with a particular web site on the Internet. 
3. Panel ads. 

In one embodiment. Panel ads occupy a fixed area in the Guide and are generally . 
1 o filled with paid advertisements. Located directly below the PIP in an Ad Window, space is 
available in the Guide for two Panel ads. Each Panel ad occupies approximately l/9th of the 
total screen area. The usable area of a Panel ad is 132 pixels high x 160 pixels wide, with 2 
pixel wide black borders all around and 2 pixels of gray on the left and right sides and 
between the two ad spaces. When a given ad space is not sold, the space will be filled with 
15. a Placeholder ad. stored in ROM. and inserted in the available space, or with a bonus ad. 

An advertiser may purchase both 1 /9th screen areas, thus creating a single ad with a 
usable space of 270 pixels high by 160 pixels wide, with 2 pixel wide black borders all 
a7ound and"2 pixels wide of gray on the left and right sides. 

In one embodiment, all Guide screens are made up of "'hard pages." A hard page is 
defined as an area comprising 9 channel slots. Each time a user scrolls below the 9*x channel 
slot, a new "hard page" appears. Scrolling back up will bring the previous hard page back 
into view. Each hard page may have different Panel ads associated with it. 

" In one embodiment. Hard pages are defined differently in the Sort screens. Each sort 
category (e.g. Movies, Sports. Children's) will be considered one hard page regardless ot the 
number of items in the list vertically. As the user moves horizontally from one category to 
the next, the Panel ads will change. 

The number of hard pages available depends on the size of the user's lineup and the 
number of channels turned on or off. In the event that there are not enough channels to 
support the number of hard pages required for the number of Panel ads sold, not all Panel ads 
will be displayed. For example, assume that 4 pairs of Panel ads and 4 Channel ads are 
saved in memory. Additionally, assume a particular user has 20 active channels m his 
channel lineup. Then the ads would be displayed as follows: 
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Panel ad Pair 1 with channels 1-8 and the first Channel ad 

Panel ad Pair 2 with channels 9-16 and the second Channel ad 

Panel ad Pair 3 with channels 17-20 and the third and fourth Channel ads 
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If the user turned on more channels requiring the addition of a fourth hard page, then 
the fourth Panel ad Pair would become visible. 

In one embodiment, the user can highlight these ads. resulting in the automatic display 
of an expanded information box. This expanded information box covers the entire right-hand 
2/3 rds of the grid. The user closes the expanded information box by moving the highlight off 
the Panel ad or by pressing the information button after the last related information box t 
screen has been presented. FIGS. 10a and 10b are graphic representations of sample on 
screen EPG displays depicting one embodiment of the feature of presenting additional 
information concerning the subject matter of a highlighted Panel Ad Window. 

In one embodiment. Panel ads are surrounded by flat black borders. When a panel ad 
is highlighted, the border turns yellow. When a program is set to record the border turns red 
(dark red when the Panel ad is not highlighted, light/bright red when highlighted). When a 
program is scheduled to watch, the border turns, orange (dark orange when the Panel ad is not 
highlighted, light/bright orange when highlighted). 

In one embodiment, there can be multiple information "screens" displayed 
sequentially in the expanded information box. Pressing the Info, button while an ad is 
highlighted accesses these additional screens. There is no finite limit to the number of 
additional screens; memory limitations and selling requirements will limit this number. 

In one embodiment if a Panel ad is highlighted, has show information associated with 

it^hd the advertised show is~currently onrthe user may tune directly to the related program 

by pressing the Left Action button (the Blue button which is labeled "Watch") or by pressing 
the Enter/Select button on the remote. Pressing the Watch button also places the show in the 
5 Record/Watch Schedule for the duration of the show to allow the user to set the frequency 
to daily or weekly. If the show is not currently on, pressing the Left Action button places the 
show in the Record/Watch Schedule or; pressing the Enter/Select button tunes to the channel 
related to the show in the ad. Shows added to the Record/Watch Schedule may be set to be 
viewed: once, daily, or weekly. The Watch feature and related Action button labels operate 
0 in the same way as if scheduling a show to watch from the Grid. 

In one embodiment, if a Panel ad has show information associated with it. the show 
may be recorded by highlighting the ad and pressing the Right Action button (the Green 
button, labeled "Record"). If the show is on now, recording begins immediately and the show 
is placed in the Record/Watch Schedule for the duration of the show to allow the user to set 
the frequency to daily or weekly. If the show is on in the future, that show is added to the 
Record/Watch Schedule for auto-recording. Shows added to the Record/Watch Schedule may 
be set to be recorded: once, daily, or weekly. The Record feature and related Action button 
labels operate in the same way as if scheduling a show to record from the Grid. 



\5 



WO 99/04561 PCT/US98/15093 



In one embodiment. Panel ads can be dynamic. There are two areas which may be 
dynamic: 1 .) the Panel ad space; and/or 2.) the Information box. 
5 The Panel ad area may change over time, e.g.. every x seconds rotating through a 

plurality of different graphical or textual ad executions in the Panel ad space. When a Panel 
ad is highlighted, the ad rotation stops on the currently displayed ad visual. The dynamic 
rotation does not restart until the Panel ad is de-highlighted. 

- The information box text associated with, the Panel ad may change over time. e.g.. 
10 every y seconds, rotating through a plurality of different screens of text. The screen rotation 
stops if the user presses the Info. Button, displaying the first page of info. text. This option 
is available for advertisers to rotate different headlines in the information box. The user may 
view subsequent pages by pressing the Info, bunon again. The screen rotation does not restart 
until after the Panel ad is de-highlighted. ' ( 
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4. Virtual Channel Ad Slots. 

The EPG provides producers of infomercials with extended capabilities to reach the 
-vrewerenhrough- V4rm^ Channel ads. Virtual Channel 

Ad Slots appear as rows of the Grid Guide and typically show the titles of the programs that 
20 are scheduled for a particular channel. The EPG Grid Guide's Virtual Channel Ad Slots 
provide advertisement to be displayed as a row in the Grid Guides schedule of programs. The 
Virtual Channel Ad Slots may be used to provide multiple exposures of a particular program 
—in the-gai-de. T1ie-Virtual~ehannel~Ad Slots-act -like-a-channel entry in the Grid Guide in that 
the viewer can record, watch, schedule for watching, and/or get information about the 
25 advertised" program in the information detail box of theGrid Guide. - 

In FIG. 1 of the drawing, tile 52 shows an example of a Virtual Channel Ad Slot for 
an ad for a television program-it is a program listing that is out of place channel-wise and 
time-wise in the Grid Guide 22. That is, it does not appear in the usual channel position or 
time position in the guide, but the tile is otherwise like the other program listing tiles of grid, 
30 guide 22 (including height), except that- it occupies the entire width of the tile irrespective of 
the-duration of the program. A tile for a normal program listing scrolls off the screen as the 
up and down arrow keys are pressed. In contrast, in one embodiment, a Virtual Channel Ad 
Slot, such as shown in tile 52, remains on the screen at all times as the up and down arrow 
keys are pressed, so the ad remains in view at all times. 

Channel ads do not occupy a fixed area. Channel ads are essentially inserted between 
channels in the grid. If there are no Channel ads sold, the grid will simply be a continuous 
list of channels/show tiles with no gaps. As these channel ads take up a channel slot in the 
grid, it is desirable to limit how many are likely to appear on any one screen to ensure the 
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Guide is a useful source of TV programming information. Typically, there will be 
approximately 1 Channel ad per hard page. 

Channel ads are typically the height of a channel slot, the width of the grid and are 
intermingled with the channel listings. . The usable area for a Channel ad is typically 24 pixels 
high x 344 pixels wide, with 2 pixel wide bevels all around. 

There are several types of Channel ads. including: Relative, Parent, and Fixed position 
Channel ads. t 

Relative Channel Ads appear in a position relative to the top of the grid and are 
spaced every n channel slots, where n is some number. These ads appear and disappear as 
the user pages through the Guide's hard pages. It is anticipated that n will usually (but not 
necessarily always) equal 9 since this is the number of channels in the PIP version grid. This 
would provide for one ad per hard page. A location for the first ad can be selected on the first 
page and subsequent ads follow every n channel slots. The same ad is repeated every « lh slot. 
This method of repeating every « lh channel slot is true for both PIP and non-PIP versions. 
Typically, as a user turns channels off, the spacing of these ads remains constant (every n 
channel slots). In the event that there are not enough channels to continue this spacing, ads 
will appear at the end of the grid listings. 

Parent Channel ads are related to a specific channel located directly above the ad. A 
Parent Channel ad is attached to its adjacent '•parent" channel (that is, the ad follows the 

parent channel). As it is desirable to limit the number of Channel ads seen on any one screen. 

the number of Parent ads will typically be limited. Additionally, if the parent channel is 
turned off, the ad will typically be displayed at the bottom of the grid. 

Fixed Position Channel ads are located in one specific location, v (where v is some 
number) channels down from the top of the grid. Ify is greater than the number of channels 
in the grid, the ad will be located at the end of the grid. 

Except as noted above regarding Parent and Fixed Position Channel ads, Channel ads 
will typically be spaced so that no more than one Channel ad is displayed at one time. 

In one embodiment, Channel ads page vertically along with the channel listing 
information: These ads remain in a fixed position when the grid is scrolled horizontally. 
The user can highlight these Channel ads just as any show title can be highlighted. When 
highlighted, these Channel ads display additional information in the info, box just as when 
any channel is highlighted. 

Channel ads are typically surrounded by bevels just like any show tile. Channel ad 
highlighting is typically similar to Panel ad highlighting. In one embodiment, when a user 
highlights a Channel ad, the bevels change to a flat (non-beveled) yellow border. When a 
Channel ad show is set to record the border turns red (dark red when not highlighted. 
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lieht/bright red when highlighted). When a Channel ad show is scheduled to watch, the 
border turns orange (dark orange when not highlighted, light/bright orange when highlighted). 

In one embodiment, Channel ads can have multiple, sequential info, box "screens" 
of information. The availability of this additional information is indicated by an "i" icon. 
The user can access the additional information by pressing the info, button. 

In one embodiment, if a Channel ad is highlighted, has show information associated 
with it, and the advertised show is currently on. the user may tune directly to the related 
program by pressing the Left Action button (the Blue button which is labeled "Watch") or 
by pressing the Enter/Select button on the remote. Pressing the Watch button also places the 
show in the Record/Watch Schedule for the duration of the show. If the show is not currently 
on, pressing the Left Action button places the show in the Record/Watch Schedule for future 
auto-viewing; pressing the Enter/Select button tunes to the channel related to the show in the 
Channel ad. Shows added to the Record/Watch- Schedule may be set to be viewed: once, 
daily, or weekly. The Watch feature and related Action button labels operate in the same way 
as if scheduling a show to watch from the Grid. 

In one embodiment, if a Channel ad has show information associated with it. the show 
may be recorded by highlighting the ad and pressing the Right Action button (the Green 
button, labeled Record). If the show is already being delivered in the television signal, 
recordine begins immediately and the show is placed in the Record/Watch Schedule for the 
duration'of the show. If the show is on in the future, the show is added to the Record/Watch 
Schedule for recording. Shows added to the Record/Watch Schedule may be set to be 
recorded: once, daily, or weekly. The Record feature and related Action button labels operate 
25 in the same way as if recording a show from the Grid. 
Channel ads can be dynamic. 
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5. Plqr phnlder Ads 

In one embodiment, when the Guide is first setup, the initial download of information 
will not have been received. The Panel ad spaces must be filled with Placeholder ads that are 
stored in ROM. These ads must be "timeless" as they will appear each time a TV is set up. 
either for the first time or after a power outage. 

One use for the Panel ad space is for help text. Help text that draws the user to select 
the ad space could serve as a ^tutorial" on how to access Panel ads, the additional information 
on info, screens, and how to Watch and Record from ads. 
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6. Full screen ads. 

When the viewer first enters the EPG. the EPG can display a full screen ad. such as 
an ad that would be displayed in the Ad Window. The viewer can interact with the full screen 
ad in the same manner in which the viewer can interact with the Ad Window. That is. the 
viewer can instruct the EPG to record, or to add to the watch list* the intbmercial or program, 
if there is one. that is associated with the advertisement. 

7. -Automatic watdrchanneh — 

Rather than have the last channel watched as the first channel tuned the next time that 
the viewer turns on the television, a channel selected by the viewer could be automatically 
tuned. In one embodiment, the viewer indicates the Automatic watch channel in the Watch 
List Function of the EPG. In another embodiment, a broadcaster sends an on-screen query 
to each viewer to enter a command if the viewer wants the broadcaster's channel to be the 
first watched channel when the viewer first turns on the television. 

8 - Ad Features. 

Ads may feature, among other things, a graphics field, a text field or a combination 
of a~graphics and text field: j 

Graphics are typically presented in 8, bit/pixel (using "320 mode"), 4 bit/pixel (in "640 
~~~modO andT bit/pixel images. In some ^bodin^ts, there will be "memory limitations. In 
-embodiments with-sueh-memory- -limitations, it is expected that Panel ads will contain 
graphics no larger than 25% of the ad area when 4 or 8 bit/pixel graphics are used. 1 00% of 
the area may be used for a 1 bit/pixel graphic: Channel ad graphics will typically, but not 
necessarily, be limited to the channel logo portion of the ad. (The use of the word "typically" 
here, and elsewhere in this application, means "typically, but not necessarily. The 
remaining portion of the Channel ad will typically be text only. 

Displayed text will typically have the following characteristics: 
- - ~ available normal and condensed 1 8 and 24 point fonts 

oblique version oT the fonts 
underlining 
bold 

centering 

left and right justification 

color can be selected once per line 

Text could also be displayed as a 1 bit/pixel bitmap in the Panel ad areas only. 
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Background colors will have an impact on the overall look and usability of the Guide. 
The following describes a typical embodiment. 

' Panel ad background. colors may be selected by the advertiser and will typically be 
subject to luminance constraints set forth below. 

Channel ad background colors may be restricted.. Show tile background colors are . 
used as keys for show categories (movies, sports, etc.) and actions taken on a show (set to 
record or watch). While most any background color could be displayed it is desirable to , 
maintain the integrity of the show tile color schemes. Therefore, it is likely that a limited set 
of background colors or a set of colors which can not be used will be specified for advertising 
agencies to use when developing Channel ad creative. Channel ad backgrounds will typically 
be subject to luminance constraints set forth below. 

The Info, box background will typically be gray and typically can not be changed by 
the advertiser. 

There-are typically limitations on the luminance of the colors in the ads. If the 
luminance is set too high, the screen image will blister. These limitations will be set, 
according to the embodimenwand-communicated to the- advertisers for their development 
consideration. Ads that do not comply with luminance restrictions for the particular 
embodiment wilTbe subject-to default override limitations. - 

In one embodiment, the viewer can interact with the ads and the television. For 
instance. Tune-in ads will allow the viewer to' tune directly to a show in progress from a 
highlighted ad block-assuming the ad block has program information associated with it. An 
in progress show associated with an ad is directly tuned by pressing either the Enter/Select 
button or the Left Action button (the Blue button labeled "Watch"). 

Direct-record ads will allow the user to record a show in progress or scheduled to be 
on in the future from a highlighted ad block. There is no practical limit on how far into the 
future a direct-record associated show may be scheduled to air. A show associated with an 
ad is recorded by pressing the Right Action button while the ad is highlighted. The user may 
-select a record frequency of once, daily or weekly. From an ad, the user presses the Right 
-Action-button (the Green button labeled "Record") to place the show in the Record Schedule. 
In the event that the show is currently on, pressing the Right Action button while highlighting 
an ad allows recording of the show in progress. The show title is also placed in the Record 
Schedule until the show ends in the event the user wishes to modify the record frequency to 
daily or weekly. 

Watch ads consist of a program advertised in any ad space. The program advertised 
may be placed into the Watch Schedule as long as the ad block has program information 
associated with it. There is no practical limit on how far into the future an associated show 
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may be scheduled to air. The Watch feature operates much the same way as the Record 
feature, except that it tunes the television ("TV") to the show rather than recording it. If a . 

5 user is watching TV, the channel automatically changes to a show placed in the Watch 
Schedule when the show begins. If the TV is turned off when a show in the Watch Schedule 
is scheduled to begin, the TV is turned on and tuned to the desired channel (TV- 
implementations only, not VCR.) The user may select a watch frequency of once; daily or , 
weekly. From an ad, the user presses the Left Action button (the Blue button labeled. 

10 "Watch") to place the show in the Watch Schedule'. In the event that the show is currently 
on, pressing the Left Action button while highlighting an ad results in tuning directly to the 
show. The show title is also placed in the Watch Schedule until the show ends in. the event 
the user wishes to modify the watch frequency to daily or weekly. 

. Ads may have multiple levels of information. Typically, First Level Information is 

15 the ad copy and/or graphics that are presented on screen with no user action. This comprises 
the Panel and Channel ad areas. 

Typically, Second Level Information (if provided by the advertiser) is automatically 
— made-visible ("Auto-Gpen") -when -the user highlights an ad block by scrolling onto it. This 
secondary information is presented in the info, box when a Channel ad is selected and in an 

20 automatically expanded version of the inforbox thatxovers the entire channel grid area when 
a Panel ad is highlighted The "f icon on the ad, placed at the advertiser's discretion, 
indicates there is more information available for that ad. The second'Ievefihformation may 
be text and/or -graphics depending on memory availability. 

Typically, Third Level Information (if provided by the advertiser) availability is 

25 indicated by the info, button^i" on a Second Level information screen. Pressing the info, 
button accesses this information and cause the information box to expand for Channel ads to 
cover the entire grid area. This information can be multiple pages long. Pressing the info, 
button successive times cycles the user through the multiple pages. Pressing the info, button 
from the last available screen causes the information box to contract to its original size for 

30 all ads. The third level information may be text and/or graphics depending upon memory 
capabilities. 

Ad Blocks can be dynamic. Memory permitting, the Panel ad graphics and/or text and 
information box text may change every A" (where Xis some number) seconds rotating through 
a limit of N (where AT is some number) different graphical or textual executions. There is the 
35 capability to limit the number of dynamic ads displayed at any one time. 

Ad duration and start time/end time can be scheduled and/or dynamic. In one 
embodiment, ads are to be displayed at a given start time with a related end time, the time 
between the start and end is the ad's duration. The minimum duration increment is typically 
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60 seconds. In one embodiment, an ad will not be replaced automatically when an ad"s end 
time arrives. Ads will only change when the user's actions cause a new "hard page." or new 
5 section of the guide to appear (e.g. going from the Grid to Sort). 

Ads can rotate. For example, different ads can appear each time the user enters the 
same page/section of the Guide. There is no hard limit on the number of ads placed in 
rotation. Ads can be assigned a priority with the ad of the highest priority being displayed ■ 
the first time a hard page or section is accessed. Then the second priority ad is displayed the 
1 o next time the user views this page and so forth. The priority counter is page dependent, 
meaning that if the user views the first page for a third time, they will see the third priority 
ad on that page and if they then scroll to the second page for the first time, they will see the 
first priority ad on the second page. 

Ads may differ by the section of the Guide being viewed. For example, if a user is 
1 5 -viewing the Sports theme area, an ad for ESPN Sports Center may appear, whereas a different 
ad was. presented when the user was on the main grid. 

The EPG can determine which advertisements to display depending upon the 
advertisement-being"displayed-o-n the television channel that the viewer was watching 
immediately before entering the EPG. That is, if a Toyota advertisement was being shown 
20 on the channel that m V viewerwaTwatchirig'af the time that the viewer entered the EPG. then 
the EPG can be timed to display a correlative Toyota advertisement in some portion of the 
EPG. e.g., the Ad Window, a television program. 

In one embodiment ."the EPG tests the Viewer Profile to determine which ad to 
displav at various times during the viewer's session with the EPG. The EPG can assign Ad 
o ^ and Page priorities to represent the advertisers" investment and the relative viewer" s profile. 

Graphically dynamic ads typically present different graphics every x seconds ( where 
x is some number, with x as small as 1 .0 second) rotating through n (where n is some number) 
oraphical or textual executions. Typically, only a limited number of these ads will be 
displayed at any one time (likely a maximum of 1 per screen) as busy screens will decrease 
30 the effectiveness of the ads and the utility of the Guide. 

Ads must be "identifiable" and "accessible" once placed in memory in order to allow 

advertisers to "pull" an ad, to update an ad. or to correct errors in transmission. 

G . improved product infor mation ACCESS BY THF. VIEWER 
l ftri Window produc t detail. 

The viewer can highlight the Ad Window to locate additional information about the 
product advertised. In one embodiment, the viewer highlights the Ad Window by pressing 
the arrow/directional navigational keys of the remote control device to navigate the remote 
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control device pointer to the location of the Ad Window on the on-screen television monitor 
display. When the remote control device pointer is located at the Ad Window on the on- 

5 screen television monitor display, the on-screen display of the Ad Window will be 
highlighted. In one embodiment, the color of the Ad Window itself will become brighter or 
show a lighted effect. In another embpdiment, the color of a border surrounding the Ad 
Window will become brighter or show a lighted effect. Highlighting the Ad Window will 
cause additional text describing the product to be displayed in the detail box are of the EPG ' 

10 Grid Guide. Alternatively, the EPG provides the producers of infomercials with the 
opportunity to provide the viewer with the opportunity to view a video clip about the product 
being advertised. 

The Ad Window can be optionally interactive. The Internet address of a web site 
containing information relevant to the ad being displayed in the Ad Window can be 'displayed 
1 5 in the Ad Window as a web site address, as an icon, or in some other graphical presentation; 
such as a stylized "i" indicating additional interactive information. Furthermore, the viewer's 
interaction with the Ad Window will be monitored by the EPG to record as part of the 
, ..viewer s.profile — . . ... „ .. ..__ r — . 

7Q 2- Ad-Window product^related recording 

The EPG provides viewers the opportunity to access extended product information 
about which the viewer is interested. Because of the cost of buying advertising time, a 

growing number of product manufacturers and marketers produce infomercials about their 

products. Because of the cost of air-time, many manufacturers and marketers buy relatively 

25 inexpensive-air -time- for their infomercials according to off-prime-time schedules, often on 
non-prime channels. The EPG.provides the viewer the opportunity to record an infomercial 
that is broadcast at a time, or on a channel, that would be inconvenient for the viewer to 
watch real-time. If the Ad Window displays information about a particular product, pressing 
a record button will instruct the EPG to record an infomercial, to the extent that one is 

30 - .scheduled for a future time. Alternatively, the viewer can designate the infomercial for the 

__WatchList. 

3. Ad Window program-related recording 

The EPG provides viewers with additional opportunities to instruct the EPG to record 
35 or watch a ftiture-scheduled television program. The Ad Window can display information 
about a future-scheduled television program. If the viewer is interested in recording the 
program, the viewer can instruct the EPG to record the future-scheduled program. In one 
embodiment, the viewer presses record button on the remote control device to instruct the 
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EPG to record the future-scheduled program. Alternatively, the viewer can instruct the EPG 
to add program to the Watch List. Alternatively, the viewer can view a video clip about the 
program. 

H. CREATION OF A VIEWER'S PROFILE i 
1~ Collecting viewer profile information. 

The EPG requests that the viewer provide certain profile information, including but 
not limited to: the viewer Vzip~ code; television, cable, and satellite services to which the 
viewer subscribes: the length of said subscriptions; the type of television: the age of the 
television: where the television was purchased: the viewer's top favorite channels: the 
viewer's favorite types of programs: and the times during which the viewer is most likely to 
watch television. If the viewer declines to provide this information, the EPG will attempt to 
"leanT the information as described below. 

In one embodiment, the EPG is capable of distinguishing between individual viewers 
and develops individualized profiles. For instance, in one embodiment, each viewer has an 
individual PIN or-other-identifieat-ion number. In another embodiment, each viewer uses an 
individualized remote. In yet another embodiment, there is an absence of a way to distinguish 
~ one"viewer from another." Iivtharcaser the profile is developed for the- family." 

Every time the viewer interacts with the EPG or the television, the EPG repords the 

viewer's actions and tlie^ircumstances surroundin^ho^e~actions. For instance, when the 
viewer changes channelsrthe EPG- records,- among other things, information about the first 
channel, the changed-to channel, the time that the change was made, the identification of the 
^ograi^ing^^^ channel, the identification of the programming 

that was displayed on the changed-to channel, the time of the change, the identification of any 
advertisement that was displayed on the first channel at the time of the change, the 
identification of any advertisement that was displayed on the changed-to channel, and 
whether the viewer changed channels while in one of the EPG modes, as opposed to being 
in the television mode. The EPG will also record every instruction by the viewer to record 
-or-watc-h-a program, whether the instruction is Once, Daily. Weekly, or Regularly. The EPG 
will also record whether the viewer changes the volume of the television audio, and if so. 
what circumstances surrounded the change in volume. If the viewer changes channels while 
in one of the EPG modes, then the EPG records information about what was displayed in each 
of the windows of the EPG UI before and after the change. 

The EPG also records information when there is an absence of interaction between 
the viewer and the television or the EPG. For instance, the EPG will record whether a viewer 
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continues to view an advertisement rather than changing channels. The EPG calculates and 
records the entire duration of the time that the television is on in any particular day. 

The EPG also records information surrounding the viewer's interaction with external 
sources of information, such as the Internet. For instance, the EPG records each search query 
criteria initiated by the viewer, the Search Engine used to make the search, the items selected 
by the viewer from the search response, interaction by the user with Internet sites, and viewer . 
interactions with the EPG during the same time-frame as the viewer interacts with the 
Internet. " 

An alternative to the above-described individual viewer profile information collection 
would be to provide on-screen survey queries. That is. the EPG could display an offer on- 
screen that would tell the viewer to call a toll-free number for the purpose of reading an on- 
screen encrypted number for the survey in exchange for a gift certificate. The offer could be 
mad e only to viewers watching a particular program or particular advertisement at a particular 
time. Survey responses would provide useful information further survey customization, 
customizing the guide, and targeting advertising. 

2. Analyzing and characterizing viewer profile in formation. 

The viewer profile information (data collected concerning, and surrounding, a 
viewer's interaction. with. the television, the EPG (including the recording and watching * 
functions), the Internet, the World Wide Web, and any other sources of information external 
to the EPG, but through which the viewer interact)) can be sent to a computer at the head end 
of television distribution for analysis, or in the alternative, can be analyzed by the EPG. 

Information about the viewer is captured on an ongoing basis. Similarly, viewer 
profile data is updated on an ongoing basis. Accordingly, the viewer profile analysis program 
(the "Profile Program"), can be repeated at some time interval to incorporate additional 
information about the viewer that has been captured since the last analysis. Alternatively, 
the Profile Program is a real time program that processes each discrete item of information 
about a viewer as the data is captured. 

.The viewer profile analysis program (the -Profile Program"), may be resident at the 
head end, in the Internet, included as part of the EPG, or distributed among these various 
possible locations. The Profile Program performs a variety of different types of analysis on 
the viewer profile data. For instance, the Profile Program performs simple statistical analysis 
of the data collected. The Profile Program accumulates, among other things, the number of 
times that the viewer: interacted with the EPG during a particular viewing session: performed 
particular types of interactions with the EPG; watched a particular channel; interacted with 
the Internet during a particular viewing session, interacted with a particular website; watched 
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and/or recorded and/or scheduled to watch a program with a particular tvpe of theme «, a 
comedy, sports, drama, movie, sitcom, science fiction, adventure, mvsterv. documental 

:> cooking, travel, etc.); and watched and/or recorded and/or scheduled to watch a program wkh ' 
a particular type of subject (e.g.. golf, tennis, football, basketball, baseball, animals food 
etc. ). or a particular actor or actress. The Profile Program also calculates the duration of each 
viewing and compiles, among other things, statistics about the times of dav and days of the' 
week during which the viewer watches television, interacts with the EPG,'or interacts with 

10 the Internet or the World Wide Web. 

Using the basic viewer profile data and the simple statistics collected about a 
particular viewer, the Profile Program -learns"' to recognize a finer breakdown about the 
various types of data collected and then uses the learned information to describe a '-'Viewer 
Preference.". For instance, if the Profile Program detects that the viewer watches sports 

1 5 programs, and that a number of sports programs are basketball games, the Profile Program 
analyzes the teams involved in the programs watched. The Profile Program is able, in this 
manner, to determine whether the viewer is a fan of a particular team. If so. the Profile 
Program records the viewer's team affiliation as a Viewer Preference. 

The Profile Program performs multiple levels of sophisticated analysis and learning 

20 involving numerous comparisons of the basic viewer profile data and the simple statistics 
collected about a particular viewer to develop Viewer Characteristics. In this way, the Profile 
Program develops a multi-dimensional profile of the viewer. For example, once the Profile- 
Program detects a Viewer Preference, the Profile Program compares, e.g.. the number of 
times that the viewer interacts with the EPG or an external information source such as the 

25 Internet/World Wide Web. during a telecast of a program that relates to the Viewer 
Preference (e.g., a basketball game involving the viewer's favorite leam) with, e.g.. the 
number of times that the viewer interacts with the EPG or an external information source such 
as the Internet/World Wide Web, during a telecast of a program that does not relate to the 
Viewer Preference. 

30 Further, the types of interactions in both sets of circumstances are analyzed. In this 

way, the Profile Program determines Viewer Characteristics relating to, among other things: 
attention span; general interest in product advertisements; interest in specific types of product 
information: propensity for impulse buying; correlation of impulse buying habits to price 
ranges, product types, and advertising formats; interest in recording and/or watching future- 

35 scheduled programs: interest in accessing additional levels of information concernine 
television programs; and interest in accessing additional levels of information concerning 
product advertisements including the correlation of such interest with the Viewer Preferences. 
Over time, with sufficient data, the EPG characterizes the viewer's sense of humor. 
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chronological age. activity age. whether the viewer is married, whether the viewer has 

children, whether the viewer has a pet and what type of pet the viewer likely has. whether the 
5 viewer is interested in buying a. particular type of appliance, whether the viewer is 

considering buying a car. the viewer's likely political affiliations, and a broad range of 

various other Viewer Characteristics. ' 

Yet further, the Profile Program analyzes an individual's Viewer Profile as compared, 

to the Viewer Profiles of others. With this cross-comparison analysis, the Profile Program 
10 can determine the likelihood that the subject viewer' will prefer or be interested in a particular 

subject, product, theme, movie, episode, etc. based on comparisons to similar Viewer 

Profiles. 

I. UTILIZATION OF VIEWER PROFILE INFORM ATION TO CUS TOMIZE VARIOUS ASPECTS 

15 OF THE EPG 

Tlie EPG and Profile Program use the basic viewer profile data, the simple statistics 

collected about a particular viewer. Viewer Preferences and Viewer Characteristics 
"(collectively, hereinafter, the "Viewer's Profile") to customize various aspects of the EPG. 
The viewer has the option to block any of these automatic customization features in the EPG 
20 Setup Mode. One aspect of the EPG that will be customized is the order of the channel slots 
presented in the Grid Guide. The order in which the channel slots are presented can be 
customized*) present the viewer's favorite channels~at the top/beginning of the Grid Guide . 

in^e^^nairig~6rtfeT^^ Viewer's Profile. 

In one embodiment, the order of the channel slots is customized according to the day 
of the week and the time of day in accordance with the Viewer's Profile. For instance, if a 
particular viewer frequently watched Nick at Nite on weekday evenings from 7pm to 10pm. 
then the EPG automatically tunes the television when turned on between 7 pm and 1 0pm. to 
the appropriate Nick at Nite channel and formats the Grid Guide to show the Nick at Nite 
channel as the first channel in the Grid Guide. If the same viewer typically watched ESPN 
"during daytime hours on Saturday and Sunday, then the EPG automatically tunes the 
television when turned on between, e.g.. 7 am through 7 pm on Saturday and Sunday to one 
of the ESPN channels and formats the Grid Guide to show the ESPN channels as the first 
several channels in the Grid Guide whenever the viewer enters the Grid Guide between, e.g., 
7 am through 7 pm on Saturday and Sunday. 

At the viewer's option, the EPG and Profile Program use the basic viewer profile 
data, the simple statistics collected about a particular viewer. Viewer Preferences and Viewer 
Characteristics to perform automatic surfing. At the viewer's option, auto surfing can be 
performed during real-time advertising telecasts. At the viewer's further option, auto surfing 
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can be performed in PIP Watch. Function, allowing the viewer to watch the program currently 
tuned in the main Picture Window, while providing auto surfing in the PIP Window. 
Alternatively, at the viewer's option, auto surfing can be performed in PIP Watch Function, 
allowing the viewer to watch the program currently tuned in the PIP Window, while 
providing auto surfing in the Main Picture Window. Still further, the viewer can choose the 
option of selecting a different advertisement to watch, or manually surfing channels of the 
viewer's choice. 

At the viewer's option, the EPG and Profile Program use the basic viewer profile 
data, the simple statistics collected about a particular viewer. Viewer Preferences and Viewer 
Characteristics to populate the Record List and/or the Watch List with programs that are 
likely to suit the viewer's interests. In one embodiment, searches for this type of information 
are conducted at a central computer at the head end. In another embodiment, queries are 
1 5 constructed and fed to an Internet search engine. • 1 

-At the viewer's option, the EPG and Profile Program use the basic viewer profile data, 
the simple statistics collected about a particular viewer, Viewer Preferences and Viewer 
—Characteristics to search-for news stories that-are-likely -to suit the viewer's interests. The 
problem that is solved is automatically (without an editorial staff) choosing news stories 
20 from multiple news-feeds for display to a particular viewer in a-news service. The content 
of the audio portion of the news broadcast is digitized and can be stored at a central computer, 
on one or more web sites, on DVD's (both video and audio recordings) local to the particular 
- viewers-television system, or in memory at the particular viewer's television system. In 
addition to the audio content, video recordings of the news stories can also be stored. 

The Viewer's Profilerand in some embodiments, specific input from the viewer, is 
then used to construct data-mining search queries to locate and deliver content that matches 
the viewer's profiled interests and/or the viewer's specific requests for information. The 
news stories are then indexed (as described elsewhere in this disclosure). The EPG presents 
the viewer with the customized index. In this way, the viewer selects the news stories for 
viewing in much the same way as the viewer selects television programs that the viewer 
wants to-watch or record. Furthermore, web sites containing additional information 
concerning the indexed news stories can be posted, e.g., as part of the detailed description 
area text presented at the time that the viewer highlights a particular news story for viewing. 

In one embodiment, Theme Guides provide "Smart Sorting" based on the Viewer's 
Profile (which is explained more fully elsewhere in this application). That is. if a program 
is on two channels, the system will select the best channel based on which of the two 
channels the viewer watches more often. In one embodiment, the Theme Guides are further 
customized according to the Viewer's Profile. For instance, an information broadcast packet 
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sent with the scores is used to order the score in the sports guide consistent with the Viewer" s 
Profile. For instance, the score for a game involving the Boston Red Sox would display the 
scores for the Red Sox first for a viewer in Boston. 

During set up procedures, the EPG provides for automatic channel map selection. 
All channel maps in the viewer's zip code are, downloaded. Zip code related options arc 
displayed. In one embodiment', the viewer is asked to identify information necessary for the , 
television to select the appropriate channel mapping option, but the television automatically 
selects the appropriate channel map. For instance, the viewer is asked to identify, e.g. the 
distribution service to which the viewer subscribes, e.g., Colonial Cable, and a particular 
channel map, e.g., does the viewer receive HBO on channel 43. In this way, the viewer 
identifies the information necessary for the television to select the appropriate channel map. 
Alternatively, the viewer is actually asked to select the channel map. e.g.. "if you have 
Colonial Cable and get HBO on channel 43. pick this channel map." 

J. UTILIZATION OF VIEWER PROFILE INFORMATION T O PROVIDE CUSTOMIZED 

PRESENTATION OF ADVE RTISING TO THE VIEWER 

The EPG and the Profile Program use Viewer Profile information to tailor the 
presentation-and scheduling of advertisements-to the viewer and to customize the presentation 
- of the EPG.foc.the user,. For instance, the EPG uses Viewer Profile information to determine 
whether to notify the viewer abTourscheduling for a program involving the viewer's favorite 
-tearm-a talk-show-involving a'star player .from that team, etc. The EPG is capable of such 
customized notification/advertisement through e.g., an advertisement in the Ad Window, or 
through an advertisement in a Virtual Ad Channel Slot. 

Additionally, the EPG and the Profile Program use Viewer Profile information to 
customize the presentation and/or scheduling of telecast advertisements that are viewable 
during the real time telecast of the television program that the viewer is watching. One 
example is customizing an overlay message to an advertisement on a local geographic basis. 
-For instance, the EPG knows the geographic location of the individual viewer. The 
broadcaster can packet match on the zip code to customize the message so each zip code gets 
a different message, i.e., the 3 Burger Kings in the viewer's local area. In one embodiment, 
the customized messages can be preloaded by zip code into the memories of particular 
viewers' EPG's. The preloaded messages can be transmitted by a head end during off hours 
and stored in the viewer's terminal for use when the advertisement runs, e.g.. during a 
television program or in a video clip in the Ad Window. The electronic trigger to run the 
message can be transmitted along with the television signal in real time and can identify the 
messages stored in the user terminal that need to be applied. 
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In another embodiment, the customized messages are narrowcast with the televised 
advertisement. One way to narrowcast the customized messages is to embed the customized ( 
information in the advertisement video stream. Another way is to transmit a digital 
"watermark" in the video stream of the advertisement. 

In one embodiment, customization of real-time viewing of advertisements is achieved . 
by providing multiple channels of advertising, by tuning the television automatically to a 
particular advertising channel at the time during the telecast of the television program during 
which an advertisement is scheduled to occur, and by then tuning the television back to the 
viewer's chosen television program at the conclusion of the advertisement. In another 
embodiment, a service monitors telecasts for advertisements as they are telecast on a 
particular channel and inserts a change channel command in the Vertical Blanking Interval 
(the "VBI") when an ad is telecast, said change channel command causing the television to 
15 tune to a particular channel for a telecast of an advertisement suitable to the Viewer's 
Preferences. 

Viewer Profile information can be reported, as with, for instance, statistical reports 
- of Viewer Profile information for many viewers. These reports could be provided for 
analysis by advertisers, head end operators. Guide producers, or others, to determine, among 
20 other things, marketing customization opportunities, narrowcasting opportunities, program 
. ..detail information requirements, and program distribution scheduling requirements. 

The EPG will attempt to capture the approximate initial purchase date (e.g., first turn- 
on date) of any television/entertainment system components. The EPG can notify the user 
at the appropriate time after the initial purchase of opportunities such as purchasing an 
25 extended warranty from the manufacturer. In one embodiment, the terminal equipment is 
separately addressable providing that such notification messages can be sent in the VBI to the 
appropriate viewer. Based on the Viewer Profile, the extended warranty offer could be 
tailored to the viewer's financial situation. 

Another way that the EPG uses Viewer Profile information is in connection with, 
30 "access-content" customization of the advertising messages displayed by the EPG. Viewer 

profile informatiojLwill^include the television program that the viewer was watching 

immediately before entering the EPG. The EPG can display different ads in the Guide or 
Service based upon the content of the television program that the viewer was watching before 
entering the EPG or one of the special data services accessible through the EPG. The 
"access-content" advertising strategy provides a much more refined way of targeting the 
consumer. For example, consider two viewers who are both watching television at 8:00 p.m. 
on a Tuesday night. When the one viewer who has been watching ~Nova" enters the EPG. 
the EPG might display an advertisement for educational computer; whereas when the second 
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viewer who has been watching Major League Baseball enters the EPG, the EPG might 
display an advertisement for Goodyear Tires. 
5 In one embodiment of this invention, a data base of advertising messages and virtual 

channel ads is stored in RAM at the viewer terminal or is accessible at a web site if the viewer 
terminal has an Internet connection. In either case, the advertising items in the data base are 
labeled with coded categories that correspond to coded category labels assigned to the telecast 
television programs. (Preferably, these are the same categories that are used to sort the 

10 programs in the on screen category or theme guide.) The category labels of the television 
programs could be stored in RAM as part of the EPG data base and retrieved from the 
applicable Show Information Package ("SIP") based on the information from the real time 
clock and the tuner setting. This information identifies a time and channel that points to the 
applicable SIP. After the category label of the last program the viewer was watching in the 

15 television mode is retrieved from the EPG, data base, this label is matched to the 
corresponding labeMn the data base of advertising messages and virtual channel ads stored 
in RAM. In FIG. 1 of the drawing, the advertising items to which the labels are attached are 

displayed in_ad windows ] 4 and 16 and the virtual channel ad displayed on tile 52 as 

described above. 

-20 Yet another-way-that-the EPG uses Viewer Profile information is in connection with 

"adjacent-content" customization of the advertising messages displayed by the EPG. Viewer 
Profile information will include identification of the content that the viewer has currently 
—highlighted in the EPG or related data service. Using this method, the EPG displays different 
advertisements depending upon, e.g., which show the viewer has currently highlighted in the 
25 Grid Guide, what -sport- is -highlighted in a sports data service, or what type of news is 
highlighted in a news service (international, local, etc.). 

The EPG can select advertisements from various possible locations, including but not 
limited to: a library of advertisements stored at the viewer's terminal in RAM that have been 
downloaded through the VBI, stored at the head-end, or accessible through an EPG link to 
30 the Internet/World Wide Web. The advertisements may be in the form of graphics, text, 
video clips, audio clips, and combinations thereof. Each advertisement can be assigned 
theme codes, profile codes, and other selection intelligence. In one embodiment, in order to 
customize the advertising display, the EPG searches the library of available advertisements 
to locate advertisements that match criteria set by the advertisers for "access content," 
35 "adjacent content," and/or Viewer Profile information. In another embodiment, the EPG 
selects advertisements for display according to pre-established selection criteria. 

The disclosures of the following patent applications are incorporated fully herein by 
reference: International Application WO96/07270; Application No. 60/053,330 filed July 21, 
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1997: Application No. 60/061,1 19 filed October 6. 1997: and Application No. 60/055.237 
filed August 12, 1997. 

In one embodiment, the advertisements in the library are assigned to themes: the 
history' of use of an on-screen iheme menu or program guide is recorded; and the history is 
analyzed by the EPG microprocessor to decide which advertisement to display. 

For example, a particular advertisement for automobiles might be assigned to. a sports 
event theme. In a simple implementation, this automobile advertisement would be selected 
for display, if the users of the particular EPG selected sports as a theme more frequently than 
any other theme during a prescribed period of time. FIG. 7 represents the on screen display 
for the top level theme screen: and FIG. 8 represents the on screen display for the second- 
level theme screen. A theme selection could be recorded when a viewer highlights a theme 
in FIG. 7. such as ^Sports". Selecting a theme brings up a screen listing, by time.' channel, 
and title, of the programs that are consistent with' the selected theme on a second-level theme 
screen"an example_of which is shown m_F_IG,_8_- The history of use could be recorded in a 
memory by overwriting the oldest data stored in the memory. If desired, a more sophisticated 
-analysis -could be used.-Thus..the_frequency.Qf T selection could be weighted to favor more 
recent selections over older selections or themes could be combined to determine which 

advertisement to display. 

In another embodiment, the advertisements in the library are assigned to particular 
television programs or classes of television programs: the history of use of the information 
box-of-the-E-PG4s-recorded,-in4erms of frequency_of the visits, time spent during a single 
visit, and/or total time of all the visits: the information boxes are correlated to the television 
programs, and the results are analyzed to decide which advertisement to display. Instead of 
the information box, any other area of the EPG screen could be monitored in similar fashion 
to decide which advertisement to display. In each case, the advertisements in the library are 
assigned to the types or subjects of information displayed in the monitored area so as to target 
better the advertisements to the interests of the users. 

In another embodiment, the advertisements in the library are also assigned to 
particular television programs or classes of television programs in terms of channel and time: 
the tuner is monitored; the channel and time are correlated to the television programs, and the 
results are analyzed to decide which advertisement to display. For example, an advertisement 
for brand name athletic shoes with a popular basketball star could be assigned to basketball 
programs. The shoe advertisement would be selected for display if the viewer of the 
particular EPG entered the EPG while watching a basketball game. 

In another embodiment, the advertisements in the library are also assigned to 
particular television programs or classes of television programs: the history of television 
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programs entered into a "record-watch list" as shown in FIG. 6 is recorded; and the results are 
analyzed to decide which advertisement to display. 
5 The time of the monitored event can also be taken into account in order to distinguish 

between multiple users of the same EPGor related television receiver. The assumption is that 
the people using the EPG and watching television at different times of the day have different ■ 
interests-housewives may use the EPG more in the morning, children may use it in the eariy 
evenings, and men who work outside the home may use it on Sunday afternoons. 
JO History of use as described above can be combined with the "access-content" model 

described in Application No. 60/055.237 to further pin-point advertisements to the user's 
interests. Thus, if the users of the particular EPG selected comedies as a theme more 
frequently than any other theme during a prescribed period of time, three advertisements 
might- be flagged and the final selection made therefrom depending upon which type of 
1 5 program the viewer was watching on television' before switching to the on-screen EPG. 

Illustrative Embodiments 

_ The "embodiments of the invention described herein are only considered to be 

preferred and/or illustrative of the inventive concept; the scope of the invention is not to be 
?0 ™restrTcted"to such embodiments. Variousand numerous" other arrangements may be devised 
by one skilled in the art without departing from the spirit and scope of this invention. For 
example, alternative display formats are possible. 
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CLAIMS: 

1 . A method for navigating about an on screen television interactive program 
5 guide comprising the steps: 

displaying a list of television programs vertically in a first area of a Screen of a display 
monitor: ,i 

displaying an advertisement in a second area of the screen located horizontally- 
adjacent to the first area; 
1 o moving an on screen cursor vertically to highlight one of the television programs in 

the first area; and 

moving the cursor horizontally from the first area to the second area to highlight the 
advertisement. 

} 5 2. The method of claim 1. additionally comprising the step of activating a 

function with respect to the highlighted advertisement. 

3. The method of claim 2, in which the function is displaying on the screen 
details about the highlighted advertisement. 



20 



3:> 



4. The method of claim 3, in which the details are displayed in the second area 
instead of the advertisement. 



5. The method of claim 3, in which the details are displayed in a third area of the 
25 screen different from the first and second areas. 

6. The method of claim 2, in which the advertisement promotes a future 
television program and the function is storing the time and channel of the future television 
program for later recording or viewing. 

30 

7. The method of claim 2, in which the function is establishing a link to an 
Internet website for display of still images or video on the screen in the second area instead 
of the advertisement. 



8. The method of claim 2, in which the function is establishing a link to an 
Internet website for display of still images or video in a third area of the screen different from 
the first and second areas. 
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9. The method of claim 1 . in which the moving step highlights the advertisement 
by display of a border around the second area. 

5 < . 

10. The method of claim 9. in which the moving step highlights the one program 
by display in a color that contrasts with the other programs. 

11. A microprocessor programmed to operate with a display monitor having a 
10' screerranda RAM so as to" generate signalsnhat display television-program listings stored in 

the RAM in a first area of the screen and other text or images stored in the RAM in a second 
area of the screen horizontally adjacent to the first area, the second area being divided into 
third, fourth, and fifth vertically arranged areas each of the third, fourth, and fifth areas 
having the same height-to-width aspect ratio as the screen and 1/9 the area of the screen. 

15 • ' 



12. The microprocessor of claim 1 1, additionally programmed so as to generate 

signals that highlight one of the program listings in the first area. 



13. The microprocessor of claim 12, additionally programmed to set a television 
20 tuner so as'to-generate signals that-display-in-the-third-area-the-Gurrent television program 
represented by the highlighted program listing. 

^4_- -7-h e mieroproeessor-of-Glaim- 1 3,-additionally programmed so as to generate 



25 



signals that display an advertisement for a future television program in the fourth area 

15. The microprocessor of claim 14, additionally programmed so as to generate 
signals that display an advertisement for a product or service in the fifth area. 

16. The microprocessor of claim 14, additionally programmed to generate signals 
30 that link to an Internet website and display images from the website in the fifth area. 

17. A television system comprising: 

a display monitor having a screen; 
a tuner; 

35 a microprocessor configured to display television program listings in a first 

area of the screen and an advertisement in a second area of the screen; and 

means for linking an Internet website to the microprocessor to display one or 
more still images or video in the second area of the screen. 
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18. The television system of claim 17. additionally comprising means for linking 
an Internet website to the microprocessor to transmit the program listings for display in the , 

5 second area of the screen to the microprocessor. 

19. An interactive television system comprising: 

means for receiving a television signal that carries a plurality of channels of video 

programs; ■ 
l0 a display monitor for displaying said video programs, graphics and other viewable 

information; 

means for selecting one of the channels carried by said television signal for display 
of a video program on said display monitor; 

a. memory in which multiple types of data are stored, including a data base of 
1 5 television scheduling data and a data base of advertising information; 

means-for- storing said data base of television scheduling data and said data base of 
advertising information in said memory; 

—means for simultaneously-formatting and displaying said television video program. 

said television scheduling data as an on screen electronic television program guide, and said 
20 aliWftisrng information on said display monitor; ■ 

means for selecting one of the displayed program titles from display of said on screen 
electronic television program guide for display on said display monitor; 

20. The interactive television system of claim 19. wherein the data base of 
25 advertising information further comprises: 

packets of data relating to the product being advertised, including graphic data, and/or 
textual data, and/or video data, and/or audio data; 

timing and correlative relationship data defining presentation and formatting 
relationships, sequencing, and timing of said graphic, textual, video, and audio data. 



30 
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21 . The interactive television system of claim 20, wherein said simultaneously 
formatting and displaying means further comprises: 

means for displaying in a first fixed position window on said display monitor the 
video signal carried by said selected channel; 

means for displaying in a second fixed position window on said display monitor the 

advertising data in viewable form. 
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22. The interactive television system of claim 21. further comprising: 

means for identifying a plurality of addresses for data sources, including data source 
5 addresses on a computer network such as the Internet or the World Wide Web. with data 
related to said advertising data; " 1 

means for selecting one or more of the said identified plurality of addresses for data 
sources with data related to said advertising data: 

jneans responsive to said data source address selection for establishing a link to the 
10 corresponding data source, including data source addresses on a computer network such as 
the Internet or the World Wide Web; 

means for displaying data from a plurality of said selected data source addresses on 
said display monitor in viewable form. 

1_5. 23... _The inter active tele vision system of claim 21. further comprising: 

means for collecting data pertaining to viewer interactions with the television and with 
the EPG. including but not limited to viewer television watching characteristics, viewer 
selections from-the EPG, viewer-interaetions-with-the Internet, and/or viewer interactions 
with the television remote control device; 

means for storing said collected viewer interaction data. 



10 
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24. The interactive television system of claim 23. further comprising: 

means for customizing the content of advertisements in the on screen EPG display ot 
advertising data according to said collected viewer interaction data. 

25. The interactive television system of claim 23. further comprising: 

means for customizing the timing and scheduling with which advertisements are 
presented in the on screen EPG display of advertising data according to said collected viewer 
interaction data. 



-49- 



BNSOOCID <WO_- 9S04S61A1 




Qwcnrv-.m <WO 990*56 i A 1 _ I . > 



0 f , 



WO 99/04561 



PCT/LS98. 1509* 



FIG. 2 




NFO 



40 



SUBSTITUTE SHEET (RULE 26) 



BNSDOCID <WO_ 990*561 Al t > 



WO 99/04561 



PCT/US98/ 15093 




SUBSTITUTE SHEET (RULE 26) 



Rfj^nnr.in <wc 9S0*S6iAi i > 



WO 99/04561 



U i: 



PCT/US98/15093 




SUBSTITUTE SHEET (RULE 26) 



3NS0OCI0 <WO. 9904561 A 1 i > 



WO 99/04561 



5 / 12 



PCT/US98/15093 




SUBSTITUTE SHEET (RULE 26) 



* WO 99/04561 



6 / .12 



PCTAJS98/15093 




SUBSTITUTE SHEET (RULE 26) 



3NSDOOD <WC. . 9«0456i A i I > 




8NSDOC1D <WC _9904561A1 .!.> 



WO 99/04561 



'8-12 



PCT/US98/15093 




SUBSTITUTE SHEET (RULE 26) 



SNSDOOD <WO„ 9904561A1 I. > 




BNSDOClD <WO„_ 990A561A1 J > 



SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 PCT/US98/ 15093 

10 12 



Q 

O 
CJ 
UJ 



x 



>- 


o 


1 — 


o 


(_) 




o y 




m i— 








o p! 




C£ < 












^ cr 


CL 
O 




q 






a*" 




























UJ > 








<; cn < 




ISS 

TATE 
PEC 


BC 


2 coco 


< 



on 



o- 
cn 

"O 

o 

CD 
=3 



> 

— UJ 



on; 

oo >- 



"CD 



o 



X 



Q_CLQ_<<<<<<<<<< 

oooLninLnLOLOLnoooo 

OOnOrOOrOrOrOOnOO 

CN rO C£) 66 



o 




BNSDOClD <WC .„590456»Ai .l.> 



SUBSTITUTE SHEET (RULE 26) 



WO 99/04561 

11/12 



PCTAJS98/15093 



UJ 



iO 

5 




UJ 
x> 
o 



CO =J UJ 
< O Ll 

o 

o 



x o" 



o 

^ LJ I— CO 

o Q o i— 
o 

to' 



• CO 

O' — 



o 
z 

UJ 
CO 



o 

5 < 



U. O OO ^ LxJ 

ozEi^S 

V°-Q> CO O ^ . 

CO t 5 -zdw> UJ 
- X o FS z , —it 

z x . _j '-Jq:i5 



15 

^ CO 

o < 

O 2 



co o ^ co i— 



X) x 



uj O 



O U. X < 
O Q- O O *- 



25 



X 



s 



^ -> < i£ X 



CO 



CO 




WO 99/04561 



12 /.12 



PCT/US98/15093 



Q 
O 

o 

UJ 



X 

o 



Ss 



SB 



6 ^ o 

3j uj (/) 
CD > Lj -J 

^ UJ ^ 

^ < Z < 
rO U - 




< ro > Z 

or — Q o 
£ op co i 

^ CM Li- I— 

±qujo 

2 uj p O H > < 
. => >- UJ < »- 5 

1 ^ Z O Ld Z 

-s. O S CE x O U. 
<i-uj<CDhUO 



00 



0- q 



o 2 -J 

X Qrr 



q: 



CO 



lO 



= «< CD 

, o Q 

O <c o S 
O UJ o 

S CX C3L- z 

z o 
9= £o£ 

0 -J U O 

^ a- o 

cn > in 
5 52 



Q_ 



El 



5 




SUBSTITUTE SHEET (RULE 26) 



BNS0OC1D <WC„ 9904561 A 1 1 > 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCTAJS98/IS093 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC<6) :H04N 5/50, 5/445 

US CL :34S/73K 734, 569 
According to International Patent Classification (IPC) or to both national classification and IPC 



FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. ; 348/731. 569, 563, 564, 565. 734, 906, 7. 10. 12, 13; 455/6.2, 6.3, 5.1, 5:2 



Documentation scare 



hed other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 
APS 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



Y,P 



US 5.734,853 A (HENDRICKS ET AU 3 I MARCH I 998, COL. I 
& 2. AND FIG. I . 

US 5.5S5.666 A (MILLER ET AU I 7 DECEMBER 1996. FIG. I 
US 5,650,63 I A (FARWELU 22 JULY I 997, FIGS.. 3-5, I 5 



1-25 

I 9-25 
I 7-25 



□ 



Further documents are listed in the continuation of Box C. Q See patent family annex. 



Spec t«l ctugorM of cited document*: 

document defining the general itiu of the art which is not considered 
to be of particular relevance 

earlier document published on or after the .ntemeuonal filing date 
document which may throw doubu on priority claim(s) or which if 
cited to establish the publication date of another citeuon or other 
special reason (as specified) 

document referring to an oral disclosure, use. exhibition or other 

document published prior U> the imernetionel filing del- but later than 
the pnonfy data claimed 



later document published after the uitamauonal filing date or priority 
date and not in conflict with the application but cited to understand 
the principle or theory underlying the invention 

document of particular relevance; the claimed invenuon cannot be 
considered novel or cannot be considered to involve an invenuve sup 
when the document is taken alone 

document of particular relevance; the claimed invenuon cannot be 
considered to involve an invenuve step when the document is 
combined with one or more other such documents, such combination 
being obvious to a person skilled in the art 

document nam bar of the same petent family 



Date 



of the actual completion of the international search 



13 OCTOBER 1998 

Name and mailing address of the ISA/US 
Commissioner of Patents and Trademarks 
Box PCT 

Washington, D.C. 20231 
Facsimile No. (703) 305-5899 



Date of mailing of the international search report 



01 DEC 1998 



Authorized officer 

WESNER SAJOUS 



Telephone No. (703) 30og38S7 




Form PCT/1SA/210 (second sheelXJuly 1992)* 



8NSDOCID <WO . , 9904561 A i J > 



